Re: VLDB Features - Mailing list pgsql-hackers

From Andrew Dunstan
Subject Re: VLDB Features
Date
Msg-id 4762DC05.1070003@dunslane.net
Whole thread Raw
In response to Re: VLDB Features  (Neil Conway <neilc@samurai.com>)
List pgsql-hackers

Neil Conway wrote:
> On Fri, 2007-12-14 at 14:48 +0200, Hannu Krosing wrote:
>   
>> How did you do it ?
>>
>> Did you enchance COPY command or was it something completely new ?
>>     
>
> By modifying COPY: COPY IGNORE ERRORS or some such would instruct COPY
> to drop (and log) rows that contain malformed data. That is, rows with
> too many or too few columns, rows that result in constraint violations,
> and rows containing columns where the data type's input function raises
> an error. The last case is the only thing that would be a bit tricky to
> implement, I think: you could use PG_TRY() around the InputFunctionCall,
> but I guess you'd need a subtransaction to ensure that you reset your
> state correctly after catching an error.
>
>
>   

Ideally I think you would put the failing input line in another table, 
or maybe another file. If a table, it would probably have to be as bytea.

cheers

andrew


pgsql-hackers by date:

Previous
From: Neil Conway
Date:
Subject: Re: VLDB Features
Next
From: Tom Lane
Date:
Subject: Re: VLDB Features