Re: Catching exceptions from COPY - Mailing list pgsql-hackers

From Greg Smith
Subject Re: Catching exceptions from COPY
Date
Msg-id Pine.GSO.4.64.0805282107090.1115@westnet.com
Whole thread Raw
In response to Catching exceptions from COPY  (Darren Reed <darrenr+postgres@fastmail.net>)
List pgsql-hackers
On Wed, 28 May 2008, Darren Reed wrote:

> Is it feasible to add the ability to catch exceptions from COPY?

Depends on what you consider feasible.  There's a start to a plan for that 
on the TODO list:  http://www.postgresql.org/docs/faqs.TODO.html but it's 
not trivial to implement.

It's also possible to do this right now using pgloader: 
http://pgfoundry.org/projects/pgloader/ That requires some setup and 
there's overhead to passing through that loading layer.

A third possibility is to write a short script specifically aimed at your 
copy need that breaks your input files into smaller chunks and loads them, 
kicking back the ones that don't load, or breaking them into even smaller 
chunks until you've found the problem line or lines.

--
* Greg Smith gsmith@gregsmith.com http://www.gregsmith.com Baltimore, MD


pgsql-hackers by date:

Previous
From: "Jonah H. Harris"
Date:
Subject: Re: intercepting WAL writes
Next
From: "Mike"
Date:
Subject: Re: intercepting WAL writes