Re: COPY vs INSERT - Mailing list pgsql-performance

From Mischa Sandberg
Subject Re: COPY vs INSERT
Date
Msg-id 1115268106.4279a40a7481a@webmail.telus.net
Whole thread Raw
In response to Re: COPY vs INSERT  (Kris Jurka <books@ejurka.com>)
Responses Re: COPY vs INSERT  (Kris Jurka <books@ejurka.com>)
List pgsql-performance
Quoting Kris Jurka <books@ejurka.com>:

> On Wed, 4 May 2005, Mischa Sandberg wrote:
>
> > Copy makes better use of the TCP connection for transmission. COPY
> uses
> > the TCP connection like a one-way pipe. INSERT is like an RPC: the
> > sender has to wait until the insert's return status roundtrips.
>
> Not true.  A client may send any number of Bind/Execute messages on
a
> prepared statement before a Sync message.  So multiple inserts may
be
> sent
> in one network roundtrip.  This is exactly how the JDBC driver
> implements batch statements.  There is some limit to the number of
> queries
> in flight at any given moment because there is the potential to
> deadlock
> if both sides of network buffers are filled up and each side is
> blocked
> waiting on a write.  The JDBC driver has conservatively selected 256
> as
> the maximum number of queries to send at once.

Hunh. Interesting optimization in the JDBC driver. I gather it is
sending a string of (;)-separated inserts. Sounds like
efficient-but-risky stuff we did for ODBC drivers at Simba ... gets
interesting when one of the insert statements in the middle fails.
Good to know. Hope that the batch size is parametric, given that you
can have inserts with rather large strings bound to 'text' columns in
PG --- harder to identify BLOBs when talking to PG, than when talking
to MSSQL/Oracle/Sybase.

--
Engineers think equations approximate reality.
Physicists think reality approximates the equations.
Mathematicians never make the connection.


pgsql-performance by date:

Previous
From: Tom Lane
Date:
Subject: Re: COPY vs INSERT
Next
From: Kris Jurka
Date:
Subject: Re: COPY vs INSERT