Re: Data loading from a flat file... - Mailing list pgsql-general
From | Pandurangan R S |
---|---|
Subject | Re: Data loading from a flat file... |
Date | |
Msg-id | 5e744e3d0601052305n26fb5e85l3bb526e685a4e46d@mail.gmail.com Whole thread Raw |
In response to | Re: Data loading from a flat file... (Angshu Kar <angshu96@gmail.com>) |
Responses |
Re: Data loading from a flat file...
|
List | pgsql-general |
Please show the output of describe command of the table On 1/6/06, Angshu Kar <angshu96@gmail.com> wrote: > More problems solved and created - Now I'm getting the error: > > null value in column "subject_id" violates not-null constraint > > and this is nothing but column A which I talked about in the very beginning! > Since its not null how can I COPY to B C and E. The same problem will arise > with field E too! > > AK > > > > On 1/6/06, Angshu Kar <angshu96@gmail.com> wrote: > > Thanks for the chmod command Pandu but the cat command is not doing > anything! > > > > And as Michael suggested that file has indeed carriage returns embedded in > fields. I opened it in my windows m/c using textpad and got: > > > > B1 > > C1 > > E1 > > B2 > > C2 > > E2 > > . > > . > > . > > > > > > > > Any more suggestions on how to solve this? :( > > > > > > > > > > > > On 1/6/06, Pandurangan R S <pandurangan.r.s@gmail.com> wrote: > > > To get rid of ^M characters you could use > > > > > > cat file | tr -d ^M > > > > > > you need to type ^V before you type ^M in the preceeding command. But > > > ^V will not be displayed on the screen. > > > > > > You might need to change directory permission too. > > > > > > use chmod +rx <username>. > > > > > > For this command to succeed you need to execute this command as root > > > or the owner of the directory > > > > > > On 1/6/06, Angshu Kar < angshu96@gmail.com > wrote: > > > > Thanks Michael. > > > > > > > > I'm using PgAdmin III 1.4.0 from my WinXP m/c to access the DB in my > linux > > > > m/c! The file has about 2GB data.It returns back to the prompt very > soon. > > > > I'm using less or vi command to view the file and getting those ^M as > > > > mentioned (i.e. between fields). Any clue how I can massage the data? > If you > > > > suggest I can try and write the script. > > > > > > > > Also, now I'm facing another permission related problem!It's throwing > the > > > > error: > > > > ERROR: could not open file "/home/akar/final.out" for reading: > Permission > > > > denied > > > > I've changed the file owner to postgres but without any avail!Also do > I > > > > need to change the permission to akar directory? How(I'm a linux > freshie)? > > > > > > > > Thanks, > > > > Angshu > > > > > > > > > > > > > > > > On 1/5/06, Michael Fuhr <mike@fuhr.org> wrote: > > > > > On Thu, Jan 05, 2006 at 11:04:16PM -0600, Angshu Kar wrote: > > > > > > Thanks Jim. the statement is running without any error but nothing > is > > > > > > getting copied into the table! > > > > > > > > > > What client are you using and what's the exact command you ran? > > > > > Does the command finish or does it never return? How much data > > > > > is there? What version of PostgreSQL are you using and on what > > > > > platform? > > > > > > > > > > > Also, my data file is showing some ^M chars like > > > > > > > > > > > > B1^M C1^M E1 > > > > > > B2^M C2^M E2 > > > > > > > > > > The ^M sequence might represent a carriage return -- how are you > > > > > viewing the file to see these characters? Are they between fields > > > > > as shown or only at the ends of lines? > > > > > > > > > > > Is it creating any trouble for the COPY command? > > > > > > > > > > Possibly; you might need to massage the data if you can't get COPY > > > > > to read it. That should be an easy job for a script (somebody here > > > > > can probably help). > > > > > > > > > > > And can we use INSERT with COPY? > > > > > > > > > > To use INSERT you'd need to read the data and generate the > appropriate > > > > > INSERT commands; that's another scripting job. > > > > > > > > > > -- > > > > > Michael Fuhr > > > > > > > > > > > > > > > > > > > > > -- > > > > Ignore the impossible but honor it ... > > > > The only enviable second position is success, since failure always > comes > > > > first... > > > > > > > > > > > -- > > > > Ignore the impossible but honor it ... > > The only enviable second position is success, since failure always comes > first... > > > > -- > > Ignore the impossible but honor it ... > The only enviable second position is success, since failure always comes > first...
pgsql-general by date: