Re: COPY command - Mailing list pgsql-novice

From Mike Nees
Subject Re: COPY command
Date
Msg-id BAY117-W6ED8C69448AFBCB3BA5A8D54D0@phx.gbl
Whole thread Raw
In response to COPY command  ("Mike Nees" <jmnees@hotmail.com>)
List pgsql-novice
Keith,

I downloaded gvim and viewed the file.  It shows the filler field in position 61 as "^@", two characters, position 62
startsthe next field. 

I've tried the following:

COPY tblparcelto_tmp FROM '/pacelto.txt' WITH NULL AS '\^@'
COPY tblparcelto_tmp FROM '/pacelto.txt' WITH NULL AS '\^\@'
COPY tblparcelto_tmp FROM '/pacelto.txt' WITH NULL AS '^@'

...and many, many other combinations to try to get it to work.  No matter what I try each record is truncated at
position60.   

Shouldn't this work?  I'm considering abandoning the WITH NULL attribute and use a line editor to take care of the
problem. It just seems like this should work and there's something about the character set or NULL value that I don't
understand.

Any suggestions would be appreciated.

Mike Nees


----------------------------------------
> Date: Wed, 16 Aug 2006 11:23:00 -0400
> From: KeithW@NarrowPathInc.com
> To: jmnees@hotmail.com
> CC: pgsql-novice@postgresql.org
> Subject: Re: [NOVICE] COPY command
>
> >>>Mike Nees wrote:
> >>>
> >>>I have several large fixed record length files that I'm trying to load into a new db.  My plan is to use a
temporarytable with one CHAR column to load the file, then use a second staging table to parse the fields and set
appropriatedata types.  When I use the COPY command to load the temporary table I only get part of the record.  When I
encountera FILLER column, which appears to be a NULL value, the rest of the record starting with the Filler doesn't
load. Total record size is 455, at position 61 is the first filler field, defined as PIC X(1) from the legacy system.
I'mable to load all the records in the file into the temporary table,  but only for positions 1 through 60.  When I
lookedat the flat file in TextPad,  TextPad lists a special character at position 61 with a value as "NUL (^@ = 0 =
0x0)".
> >>>
> >>>My questions:
> >>>
> >>>Are these just null characters?
> >>>Not knowing PERL; Is there any easy solution to removing these characters programmatically prior to using the COPY
command?
> >>>
> >>>
> >>>I can manually remove the NULL characters, but I'm looking for a better solution.
> >>>
> >>>
> >>>Any help would be appreciated.
> >>>
> >>>Thanks,
> >>>
> >>>
> >>>Mike
> >>
> >>Mike,
> >>
> >>The COPY command does allow you to define the NULL character using the
> >>WITH NULL AS attribute.
> >>
> >>COPY mytable
> >>FROM 'myfile'
> >>WITH NULL AS 'null string';
> >>
> >>See http://www.postgresql.org/docs/8.0/interactive/sql-copy.html
> >>
> >>HTH
> >>--
> >>
> >>Kind Regards,
> >>Keith
> >
> > Mike Nees wrote:
> > How do I figure out what the "NULL" string would be?  The value from TextPad?  BTW, I'm running Postgres on XP.
> >
> >
> >
> >
> > J. Michael Nees
> > jmnees@hotmail.com
>
> Mike,
>
> The value shown in TextPad might work.  If it were me on a Windows box I
> would be using gvim to try and determine the same thing.
>
> --
>
> Kind Regards,
> Keith
>
> ---------------------------(end of broadcast)---------------------------
> TIP 3: Have you checked our extensive FAQ?
>
>                http://www.postgresql.org/docs/faq

_________________________________________________________________
Try Live.com - your fast, personalized homepage with all the things you care about in one place.
http://www.live.com/getstarted

pgsql-novice by date:

Previous
From: Sean Davis
Date:
Subject: Re: Error when creating function in psotgresql 8.1
Next
From: Michael Fuhr
Date:
Subject: Re: [GENERAL] DB insert Error