Re: Data loading from a flat file... - Mailing list pgsql-general

From Angshu Kar
Subject Re: Data loading from a flat file...
Date
Msg-id df8328740601052230h30b66b51g154ac459f5975852@mail.gmail.com
Whole thread Raw
In response to Re: Data loading from a flat file...  (Angshu Kar <angshu96@gmail.com>)
List pgsql-general
I've solved the permission issue but now the error is:


ERROR:  missing data for column "subject_entry_id"
CONTEXT:  COPY distance, line 1: "107128"

I feel the ^M is creating the problem! Any means to remove that? I mean using the delimiters option?



On 1/6/06, Angshu Kar <angshu96@gmail.com> wrote:
Thanks Michael.

I'm using PgAdmin III 1.4.0 from my WinXP m/c to access the DB in my linux m/c! The file has about 2GB data.It returns back to the prompt very soon.
I'm using less or vi command to view the file and getting those ^M as mentioned (i.e. between fields). Any clue how I can massage the data? If you suggest I can try and write the script.

Also, now I'm facing another permission related problem!It's throwing the error:
ERROR:  could not open file "/home/akar/final.out" for reading: Permission denied
I've changed the file owner to postgres but without any avail!Also do I need to change the permission to akar directory? How(I'm a linux freshie)?

Thanks,
Angshu



On 1/5/06, Michael Fuhr <mike@fuhr.org> wrote:
On Thu, Jan 05, 2006 at 11:04:16PM -0600, Angshu Kar wrote:
> Thanks Jim. the statement is running without any error but nothing is
> getting copied into the table!

What client are you using and what's the exact command you ran?
Does the command finish or does it never return?  How much data
is there?  What version of PostgreSQL are you using and on what
platform?

> Also, my data file is showing some ^M chars like
>
> B1^M   C1^M   E1
> B2^M   C2^M   E2

The ^M sequence might represent a carriage return -- how are you
viewing the file to see these characters?  Are they between fields
as shown or only at the ends of lines?

> Is it creating any trouble for the COPY command?

Possibly; you might need to massage the data if you can't get COPY
to read it.  That should be an easy job for a script (somebody here
can probably help).

> And can we use INSERT with COPY?

To use INSERT you'd need to read the data and generate the appropriate
INSERT commands; that's another scripting job.

--
Michael Fuhr



--
Ignore the impossible but honor it ...
The only enviable second position is success, since failure always comes first...



--
Ignore the impossible but honor it ...
The only enviable second position is success, since failure always comes first...

pgsql-general by date:

Previous
From: Angshu Kar
Date:
Subject: Re: Data loading from a flat file...
Next
From: Pandurangan R S
Date:
Subject: Re: Data loading from a flat file...