Thread: problems with copy

problems with copy

From
chester c young
Date:
I'm getting lots of delimited files from Excel and MySQL users that,
mid-file, begin truncating lines if ending in null values.

for example:
1781: "one","two","three",,,,,,
1782: "one","two","three",,
1783: "one","two","three",,

(delimited files from Open Office are well behaved)

is there any way to handle this apparently standard aberration in PG?


     ____________________________________________________________________________________
Fussy? Opinionated? Impossible to please? Perfect.  Join Yahoo!'s user panel and lay it on us.
http://surveylink.yahoo.com/gmrs/yahoo_panel_invite.asp?a=7
 



Re: problems with copy

From
Luis Carlos Ferreira
Date:
El Lun 24 Sep 2007 21:38, chester c young escribió:
> I'm getting lots of delimited files from Excel and MySQL users that,
> mid-file, begin truncating lines if ending in null values.
>
> for example:
> 1781: "one","two","three",,,,,,
> 1782: "one","two","three",,
> 1783: "one","two","three",,
>
> (delimited files from Open Office are well behaved)
>
> is there any way to handle this apparently standard aberration in PG?
>
You need to normalize the csv files filtering its contents with some script
...
...
$fields_in_table=9;
while (<>) {chomp;@f=split(",");for $i ( 0 .. $fields_in_table ) {   print $f[$i].",";};print "\n";
};
...
...

--

Luis