Re: Cannot import logs from csv - Mailing list pgsql-general

From Rion Massie
Subject Re: Cannot import logs from csv
Date
Msg-id CAPsU2tms03YsvyUqR-EzCLpRoKf+NaOyY+VVWtB-FQuYJuc+bQ@mail.gmail.com
Whole thread Raw
In response to Re: Cannot import logs from csv  (Adrian Klaver <adrian.klaver@gmail.com>)
List pgsql-general
It looks to me like there's one extra column in the line. There are 8 fields after "detail" in the log line but only 7 fields after "detail" in the table.


On Fri, Oct 18, 2013 at 8:17 AM, Adrian Klaver <adrian.klaver@gmail.com> wrote:
On 10/18/2013 08:07 AM, Helen Griffiths wrote:
Hello.

I've got a table set up on server B to store the logs from server A, as
outlined in
http://www.postgresql.org/docs/8.4/static/runtime-config-logging.html#RUNTIME-CONFIG-LOGGING-CSVLOG



Every day, I set \encoding SQL_ASCII on server B (server A is SQL_ASCII)
and use \copy with the csv flag to upload yesterday's log file to the
table.  For months, this has worked flawlessly until 12th October.  The
import failed with a message:
postgres=# \copy maincluster_log FROM maincluster-20131011.csv CSV
ERROR:  extra data after last expected column
CONTEXT:  COPY maincluster_log, line 424855: "2013-10-11 15:58:59.463
BST,"apachemitre","course_records",30875,"[local]",52581233.789b,3,"idle",20..."


The failing line, I will give at the end because it is long.

PostgreSQL version on both servers is 8.4, running on CentOS 6.3.

Please, does anyone have some insight into why this fails?

This came up before recently in this thread:

http://www.postgresql.org/message-id/CADK3HHJNEWKD9gNyXmjv9ABbn+37rY3Mvp9=1j7msg9YpoBBBw@mail.gmail.com

To cut to the chase, in that case the OP found:

"Ok, I found the offending line. It was not the pgadmin line. There was a line with a large binary insert."

Not sure if that helps.


Helen Griffiths


--
Adrian Klaver
adrian.klaver@gmail.com



--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general

pgsql-general by date:

Previous
From: akp geek
Date:
Subject: Re: Need some help on Performance 9.0.4
Next
From: bobJobS
Date:
Subject: Analyze during a transaction