Re: Different length lines in COPY CSV - Mailing list pgsql-hackers

From Tom Lane
Subject Re: Different length lines in COPY CSV
Date
Msg-id 22169.1134366145@sss.pgh.pa.us
Whole thread Raw
In response to Re: Different length lines in COPY CSV  (Bruce Momjian <pgman@candle.pha.pa.us>)
Responses Re: Different length lines in COPY CSV  ("Andrew Dunstan" <andrew@dunslane.net>)
List pgsql-hackers
Bruce Momjian <pgman@candle.pha.pa.us> writes:
> Christopher Kings-Lynne wrote:
>> Is there any way to force COPY to accept that there will be lines of 
>> different length in a data file?

> I suppose we could have a TRAILINGNULL flag to COPY but because few ask
> for this feature, it hardly seems worth it.

There is no chance that we'll ever be able to cope with every insane
file format that some benighted program claims is CSV.  The harder we
try, the more we will lose the ability to detect data errors at all;
not to mention the likely negative consequences for the readability
and performance of the COPY code.  I think "fix it with a perl script"
is a very reasonable answer for cases like this one.
        regards, tom lane


pgsql-hackers by date:

Previous
From: Bruce Momjian
Date:
Subject: Re: Different length lines in COPY CSV
Next
From: Tino Wildenhain
Date:
Subject: Re: Please Help: PostgreSQL Query Optimizer