Re: pg_dump / copy bugs with "big lines" ? - Mailing list pgsql-hackers

From Bruce Momjian
Subject Re: pg_dump / copy bugs with "big lines" ?
Date
Msg-id 20160423005826.GB5939@momjian.us
Whole thread Raw
In response to Re: pg_dump / copy bugs with "big lines" ?  (Michael Paquier <michael.paquier@gmail.com>)
Responses Re: pg_dump / copy bugs with "big lines" ?  (Michael Paquier <michael.paquier@gmail.com>)
List pgsql-hackers
On Thu, Mar  3, 2016 at 10:31:26AM +0900, Michael Paquier wrote:
> On Thu, Mar 3, 2016 at 12:47 AM, Alvaro Herrera
> <alvherre@2ndquadrant.com> wrote:
> > Well, the CopyData message has an Int32 field for the message length.
> > I don't know the FE/BE protocol very well but I suppose each row
> > corresponds to one CopyData message, or perhaps each column corresponds
> > to one CopyData message.  In either case, it's not possible to go beyond
> > 2GB without changing the protocol ...
> 
> Based on what I know from this stuff (OOM libpq and other stuff
> remnants), one 'd' message means one row. fe-protocol3.c and
> CopySendEndOfRow in backend's copy.c are confirming that as well. I am
> indeed afraid that having extra logic to get chunks of data will
> require extending the protocol with a new message type for this
> purpose.

Is there any documentation that needs updating based on this research?

--  Bruce Momjian  <bruce@momjian.us>        http://momjian.us EnterpriseDB
http://enterprisedb.com

+ As you are, so once was I. As I am, so you will be. +
+                     Ancient Roman grave inscription +



pgsql-hackers by date:

Previous
From: Stephen Frost
Date:
Subject: Re: pg_dump dump catalog ACLs
Next
From: Robert Haas
Date:
Subject: Re: EXPLAIN VERBOSE with parallel Aggregate