Re: Copy command-Out of memory error - Mailing list pgsql-novice

From Tom Lane
Subject Re: Copy command-Out of memory error
Date
Msg-id 2574.1349808215@sss.pgh.pa.us
Whole thread Raw
In response to Copy command-Out of memory error  (nipuna <nipunajoset@gmail.com>)
Responses Re: Copy command-Out of memory error
List pgsql-novice
nipuna <nipunajoset@gmail.com> writes:
> I am trying to copy a 13G file to postgres db using the 'copy from' command on PGSQL 8.4. After loading 8 million
recordsI got the below error . 

> ERROR: out of memory

> DETAIL: Cannot enlarge string buffer containing 1073726116 bytes by 65536 more bytes.
> CONTEXT: COPY teststorage, line 8479575

This makes it look like line 8479575 is, all by itself, wider than 1GB.
If that's really what your data is, you'll need to find some other
representation --- Postgres can't cope with fields wider than 1GB.
(And in practice you don't want to be coming anywhere close to that
limit anyway.)

If you didn't think you had individual rows that wide, maybe this is
due to some sort of quoting or escaping problem in your data file.

            regards, tom lane


pgsql-novice by date:

Previous
From: nipuna
Date:
Subject: Copy command-Out of memory error
Next
From: Nipuna
Date:
Subject: Re: Copy command-Out of memory error