Re: Data loading from a flat file... - Mailing list pgsql-general

cat test | paste - - -

This will merge three consecutive lines into a single line. Note that
there is a space between each -.

On 1/6/06, Angshu Kar <angshu96@gmail.com> wrote:
> More problems solved and created - Now I'm getting the error:
>
>  null value in column "subject_id" violates not-null constraint
>
> and this is nothing but column A which I talked about in the very beginning!
> Since its not null how can I COPY to B C and E. The same problem will arise
> with field E too!
>
> AK
>
>
>
> On 1/6/06, Angshu Kar <angshu96@gmail.com> wrote:
> > Thanks for the chmod command Pandu but the cat command is not doing
> anything!
> >
> > And as Michael suggested that file has indeed carriage returns embedded in
> fields. I opened it in my windows m/c using textpad and got:
> >
> > B1
> >     C1
> >     E1
> > B2
> >     C2
> >     E2
> > .
> > .
> > .
> >
> >
> >
> > Any more suggestions on how to solve this? :(
> >
> >
> >
> >
> >
> > On 1/6/06, Pandurangan R S <pandurangan.r.s@gmail.com> wrote:
> > > To get rid of ^M characters you could use
> > >
> > > cat file | tr -d ^M
> > >
> > > you need to type ^V before you type ^M in the preceeding command. But
> > > ^V will not be displayed on the screen.
> > >
> > > You might need to change directory permission too.
> > >
> > > use chmod +rx <username>.
> > >
> > > For this command to succeed you need to execute this command as root
> > > or the owner of the directory
> > >
> > > On 1/6/06, Angshu Kar < angshu96@gmail.com > wrote:
> > > > Thanks Michael.
> > > >
> > > > I'm using PgAdmin III 1.4.0 from my WinXP m/c to access the DB in my
> linux
> > > > m/c! The file has about 2GB data.It returns back to the prompt very
> soon.
> > > > I'm using less or vi command to view the file and getting those ^M as
> > > > mentioned (i.e. between fields). Any clue how I can massage the data?
> If you
> > > > suggest I can try and write the script.
> > > >
> > > > Also, now I'm facing another permission related problem!It's throwing
> the
> > > > error:
> > > > ERROR:  could not open file "/home/akar/final.out" for reading:
> Permission
> > > > denied
> > > >  I've changed the file owner to postgres but without any avail!Also do
> I
> > > > need to change the permission to akar directory? How(I'm a linux
> freshie)?
> > > >
> > > > Thanks,
> > > > Angshu
> > > >
> > > >
> > > >
> > > > On 1/5/06, Michael Fuhr <mike@fuhr.org> wrote:
> > > > > On Thu, Jan 05, 2006 at 11:04:16PM -0600, Angshu Kar wrote:
> > > > > > Thanks Jim. the statement is running without any error but nothing
> is
> > > > > > getting copied into the table!
> > > > >
> > > > > What client are you using and what's the exact command you ran?
> > > > > Does the command finish or does it never return?  How much data
> > > > > is there?  What version of PostgreSQL are you using and on what
> > > > > platform?
> > > > >
> > > > > > Also, my data file is showing some ^M chars like
> > > > > >
> > > > > > B1^M   C1^M   E1
> > > > > > B2^M   C2^M   E2
> > > > >
> > > > > The ^M sequence might represent a carriage return -- how are you
> > > > > viewing the file to see these characters?  Are they between fields
> > > > > as shown or only at the ends of lines?
> > > > >
> > > > > > Is it creating any trouble for the COPY command?
> > > > >
> > > > > Possibly; you might need to massage the data if you can't get COPY
> > > > > to read it.  That should be an easy job for a script (somebody here
> > > > > can probably help).
> > > > >
> > > > > > And can we use INSERT with COPY?
> > > > >
> > > > > To use INSERT you'd need to read the data and generate the
> appropriate
> > > > > INSERT commands; that's another scripting job.
> > > > >
> > > > > --
> > > > > Michael Fuhr
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Ignore the impossible but honor it ...
> > > > The only enviable second position is success, since failure always
> comes
> > > > first...
> > >
> >
> >
> >
> > --
> >
> > Ignore the impossible but honor it ...
> > The only enviable second position is success, since failure always comes
> first...
>
>
>
> --
>
> Ignore the impossible but honor it ...
> The only enviable second position is success, since failure always comes
> first...