Re: importing a messy text file - Mailing list pgsql-general

From Rémi Cura
Subject Re: importing a messy text file
Date
Msg-id CAJvUf_tbjAe_du3n8-tUcup2i4kn4oVNZCx05UsA8fpN8bs+TQ@mail.gmail.com
Whole thread Raw
In response to Re: importing a messy text file  (Willy-Bas Loos <willybas@gmail.com>)
Responses Re: importing a messy text file  (Willy-Bas Loos <willybas@gmail.com>)
List pgsql-general
Hey,
with latest version 9.3 you can use a copy from with a programm as argument.
I had a similar problem (an extra space at the end of each line), so I used sed in a pipeline to remove it before feeding it to database.

You can use the unix | pipe for most of the stuff.

If you have an older version you can use the mkfifo command to "trick" postgres into believing he will copy from a file.

Cheers,
Rémi-C


2014-04-30 10:47 GMT+02:00 Willy-Bas Loos <willybas@gmail.com>:
Alberto, it would be hard to use sed( s/^I$// ), because there is no explicit NULL value and there are many NULLs in the last column.
So i can't be sure how many tabs should be in the end of each line.

Yes, Karsten, maybe scripting would be the easiest way to fix this, i would then probably insert this line for line. That's a possibility. It might take a long time to run, but that's not much of an issue.

--
Willy-Bas Loos

pgsql-general by date:

Previous
From: Alberto Cabello Sánchez
Date:
Subject: Re: importing a messy text file
Next
From: Willy-Bas Loos
Date:
Subject: Re: importing a messy text file