Re: Bulk COPY end of copy delimiter - Mailing list pgsql-performance

From Steven Rosenstein
Subject Re: Bulk COPY end of copy delimiter
Date
Msg-id OF229BBBF2.C5C5472F-ON85256FDA.0010AAC3-85256FDA.0010F55F@us.ibm.com
Whole thread Raw
In response to Re: Bulk COPY end of copy delimiter  (Gavin Sherry <swm@alcove.com.au>)
List pgsql-performance



Your assumption is correct.  The data was generated out of a DB2 database,
and uses commas as field delimiters.

Thank you for the workaround,
--- Steve
___________________________________________________________________________________

Steven Rosenstein
IT Architect/Developer | IBM Virtual Server Administration
Voice/FAX: 845-689-2064 | Cell: 646-345-6978 | Tieline: 930-6001
Text Messaging: 6463456978 @ mobile.mycingular.com
Email: srosenst @ us.ibm.com

"Learn from the mistakes of others because you can't live long enough to
make them all yourself." -- Eleanor Roosevelt



             Gavin Sherry
             <swm@alcove.com.a
             u>                                                         To
             Sent by:                  Steven Rosenstein/New
             pgsql-performance         York/IBM@IBMUS
             -owner@postgresql                                          cc
             .org                      pgsql-performance@postgresql.org
                                                                   Subject
                                       Re: [PERFORM] Bulk COPY end of copy
             04/04/2005 08:00          delimiter
             PM









Hi,

On Mon, 4 Apr 2005, Steven Rosenstein wrote:

>
>
>
>
> Today while trying to do a bulk COPY of data into a table, the process
> aborted with the following error message:
>
> ERROR: end-of-copy marker corrupt
> CONTEXT: COPY tbl_logged_event, line 178519: "606447014,1492,2005-02-24
> 03:16:14,2005-02-23 20:27:48,win_applog,,error,adsmclientservice,nt
> author..."
>
> Googling the error, we found reference to the '\.' (backslash-period)
being
> an "end-of-copy marker".  Unfortunately, our data contains the
> backslash-period character sequence.  Is there any know fix or workaround
> for this condition?

Any sequence \. in COPY input data should be escaped as \\. If this data
was generated by pg_dump then its a problem, but I haven't seen any other
reports of this. Can I assume that you've generated the data for bulk load
yourself? If so, there is discussion of escaping characters here:
http://www.postgresql.org/docs/8.0/static/sql-copy.html.

Gavin

---------------------------(end of broadcast)---------------------------
TIP 3: if posting/reading through Usenet, please send an appropriate
      subscribe-nomail command to majordomo@postgresql.org so that your
      message can get through to the mailing list cleanly



pgsql-performance by date:

Previous
From: Christopher Petrilli
Date:
Subject: Re: Sustained inserts per sec ... ?
Next
From: Tom Lane
Date:
Subject: Re: Sustained inserts per sec ... ?