Re: COPY FROM : out of memory - Mailing list pgsql-general

From Terry Fielder
Subject Re: COPY FROM : out of memory
Date
Msg-id 4565D172.5070603@ashtonwoodshomes.com
Whole thread Raw
In response to Re: COPY FROM : out of memory  (Tom Lane <tgl@sss.pgh.pa.us>)
Responses Postgres scalability and performance on windows  ("Gopal" <gopal@getmapping.com>)
List pgsql-general
Tom Lane wrote:
Arnaud Lesauvage <thewild@freesurf.fr> writes: 
When trying to import a 20M rows csv file into PostgreSQL, I 
get :   
 
ERROR: out of memory
État SQL :53200
Détail :Failed on request of size 1073741823.
Contexte : COPY tmp, line 1   
Can you put together a self-contained example?  The reference to "line
1" suggests that you wouldn't need the whole 20M row file, just the
first few rows ... 
Unless its not seeing the end of the first record AS the end of the first record, and hence seeing the whole file as 1 record.

Terry

		regards, tom lane

---------------------------(end of broadcast)---------------------------
TIP 4: Have you searched our list archives?
              http://archives.postgresql.org/
 

pgsql-general by date:

Previous
From: "A. Kretschmer"
Date:
Subject: Re: A generic trigger to log chanes on database tables
Next
From: Richard Broersma Jr
Date:
Subject: Re: Why overlaps is not working