Thread: pgsql: Pack tuples in a hash join batch densely, to save memory.

pgsql: Pack tuples in a hash join batch densely, to save memory.

From
Heikki Linnakangas
Date:
Pack tuples in a hash join batch densely, to save memory.

Instead of palloc'ing each HashJoinTuple individually, allocate 32kB chunks
and pack the tuples densely in the chunks. This avoids the AllocChunk
header overhead, and the space wasted by standard allocator's habit of
rounding sizes up to the nearest power of two.

This doesn't contain any planner changes, because the planner's estimate of
memory usage ignores the palloc overhead. Now that the overhead is smaller,
the planner's estimates are in fact more accurate.

Tomas Vondra, reviewed by Robert Haas.

Branch
------
master

Details
-------
http://git.postgresql.org/pg/commitdiff/45f6240a8fa9d35548eb2ef23dba2c11540aa02a

Modified Files
--------------
src/backend/executor/nodeHash.c |  151 +++++++++++++++++++++++++++++++--------
src/include/executor/hashjoin.h |   22 ++++++
2 files changed, 145 insertions(+), 28 deletions(-)