pgsql: Pack tuples in a hash join batch densely, to save memory. - Mailing list pgsql-committers

From Heikki Linnakangas
Subject pgsql: Pack tuples in a hash join batch densely, to save memory.
Date
Msg-id E1XRmZn-0002EE-Pc@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
Pack tuples in a hash join batch densely, to save memory.

Instead of palloc'ing each HashJoinTuple individually, allocate 32kB chunks
and pack the tuples densely in the chunks. This avoids the AllocChunk
header overhead, and the space wasted by standard allocator's habit of
rounding sizes up to the nearest power of two.

This doesn't contain any planner changes, because the planner's estimate of
memory usage ignores the palloc overhead. Now that the overhead is smaller,
the planner's estimates are in fact more accurate.

Tomas Vondra, reviewed by Robert Haas.

Branch
------
master

Details
-------
http://git.postgresql.org/pg/commitdiff/45f6240a8fa9d35548eb2ef23dba2c11540aa02a

Modified Files
--------------
src/backend/executor/nodeHash.c |  151 +++++++++++++++++++++++++++++++--------
src/include/executor/hashjoin.h |   22 ++++++
2 files changed, 145 insertions(+), 28 deletions(-)


pgsql-committers by date:

Previous
From: Andres Freund
Date:
Subject: pgsql: Add support for optional_argument to our own getopt_long() imple
Next
From: Robert Haas
Date:
Subject: pgsql: Fix thinko in 0709b7ee72e4bc71ad07b7120acd117265ab51d0.