pgsql: Improve memory management for external sorts. - Mailing list pgsql-committers

From Robert Haas
Subject pgsql: Improve memory management for external sorts.
Date
Msg-id E1ageG4-0001Sj-RW@gemulon.postgresql.org
Whole thread Raw
Responses Re: pgsql: Improve memory management for external sorts.  (Aleksander Alekseev <a.alekseev@postgrespro.ru>)
Re: pgsql: Improve memory management for external sorts.  (Andres Freund <andres@anarazel.de>)
List pgsql-committers
Improve memory management for external sorts.

Introduce a new memory context which stores tuple data, and reset it
at the end of each merge pass; this helps avoid memory fragmentation
and, consequently, overallocation.  Also, for the final merge patch,
eliminate memory context chunk header overhead entirely by allocating
all of the memory used for buffering tuples during the merge in a
single chunk.  Since this modestly increases the number of tuples we
can store, grow the memtuples array a bit so that we're less likely to
run short of slots there.

Peter Geoghegan.  Review and testing of patches in this series by
Jeff Janes, Greg Stark, Mithun Cy, and me.

Branch
------
master

Details
-------
http://git.postgresql.org/pg/commitdiff/0011c0091e886b874e485a46ff2c94222ffbf550

Modified Files
--------------
src/backend/utils/sort/tuplesort.c | 556 ++++++++++++++++++++++++++++++++++---
1 file changed, 516 insertions(+), 40 deletions(-)


pgsql-committers by date:

Previous
From: Tom Lane
Date:
Subject: pgsql: Fix assorted breakage in to_char()'s OF format option.
Next
From: Robert Haas
Date:
Subject: pgsql: Update tuplesort.c comments for memory mangement improvements.