pgsql: In COPY, insert tuples to the heap in batches. - Mailing list pgsql-committers

From Heikki Linnakangas
Subject pgsql: In COPY, insert tuples to the heap in batches.
Date
Msg-id E1RO47X-0001EJ-6D@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
In COPY, insert tuples to the heap in batches.

This greatly reduces the WAL volume, especially when the table is narrow.
The overhead of locking the heap page is also reduced. Reduced WAL traffic
also makes it scale a lot better, if you run multiple COPY processes at
the same time.

Branch
------
master

Details
-------
http://git.postgresql.org/pg/commitdiff/d326d9e8ea1d690cf6d968000efaa5121206d231

Modified Files
--------------
src/backend/access/heap/heapam.c |  484 ++++++++++++++++++++++++++++++++++----
src/backend/commands/copy.c      |  166 ++++++++++++-
src/backend/postmaster/pgstat.c  |    6 +-
src/include/access/heapam.h      |    2 +
src/include/access/htup.h        |   31 +++
src/include/pgstat.h             |    2 +-
6 files changed, 629 insertions(+), 62 deletions(-)


pgsql-committers by date:

Previous
From: Tom Lane
Date:
Subject: pgsql: Tweak new regression test case for more portability.
Next
From: Robert Haas
Date:
Subject: pgsql: Fix compiler warning.