pgsql: In psql \copy from, send data to server in larger chunks. - Mailing list pgsql-committers

From Heikki Linnakangas
Subject pgsql: In psql \copy from, send data to server in larger chunks.
Date
Msg-id E1m3bqT-0003Qc-JW@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
In psql \copy from, send data to server in larger chunks.

Previously, we would send each line as a separate CopyData message.
That's pretty wasteful if the table is narrow, as each CopyData message
has 5 bytes of overhead. For efficiency, buffer up and pack 8 kB of
input data into each CopyData message.

The server also sends each line as a separate CopyData message in COPY TO
STDOUT, and that's similarly wasteful. But that's documented in the FE/BE
protocol description, so changing that would be a wire protocol break.

Reviewed-by: Aleksander Alekseev
Discussion: https://www.postgresql.org/message-id/40b2cec0-d0fb-3191-2ae1-9a3fe16a7e48%40iki.fi

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/eec57115e4c866f26bdc8bcbe3e2e7be4c6d0450

Modified Files
--------------
src/bin/psql/copy.c | 99 ++++++++++++++++++++++++++++++-----------------------
1 file changed, 56 insertions(+), 43 deletions(-)


pgsql-committers by date:

Previous
From: Magnus Hagander
Date:
Subject: pgsql: Clarify description of pg_stat_statements columns
Next
From: Thomas Munro
Date:
Subject: Re: pgsql: Add PSQL_WATCH_PAGER for psql's \watch command.