Thread: Re: [HACKERS] "CANNOT EXTEND" -

The flat files are sitting at 1.9 GB right now (the primary email table).

So I'm approaching the point where I can't backup using the COPY command.

I'm probably using the wrong OS for this. But the performance of postgres is
still dazzling me (some people complain about the performance, but when I
see it pick 10,000 rows out of 1.4 million, sort them, and return them in a
second, I'm blown away).

Tim

-----Original Message-----
From: Bruce Momjian <maillist@candle.pha.pa.us>
To: perdue@raccoon.com <perdue@raccoon.com>
Cc: pgsql-hackers@hub.org <pgsql-hackers@hub.org>
Date: Wednesday, March 17, 1999 8:46 PM
Subject: Re: [HACKERS] "CANNOT EXTEND" -


>[Charset iso-8859-1 unsupported, filtering to ASCII...]
>> It won't be long for me until that happens. Not long at all. Considering
>> I've amassed 2.2 GB in just 3-4 weeks....
>
>How large are your flat files.  Also, the postgresql problems are with
>files that are exactly 2gig.  It is possible files over that will be ok.
>
>
>--
>  Bruce Momjian                        |  http://www.op.net/~candle
>  maillist@candle.pha.pa.us            |  (610) 853-3000
>  +  If your life is a hard drive,     |  830 Blythe Avenue
>  +  Christ can be your backup.        |  Drexel Hill, Pennsylvania 19026

[Charset iso-8859-1 unsupported, filtering to ASCII...]
> The flat files are sitting at 1.9 GB right now (the primary email table).
> 
> So I'm approaching the point where I can't backup using the COPY command.
> 
> I'm probably using the wrong OS for this. But the performance of postgres is
> still dazzling me (some people complain about the performance, but when I
> see it pick 10,000 rows out of 1.4 million, sort them, and return them in a
> second, I'm blown away).

Please see if you can create files over 2 gig.  I believe is it only OS
bugs in dealing with exactly 2gig files that is the problem.

--  Bruce Momjian                        |  http://www.op.net/~candle maillist@candle.pha.pa.us            |  (610)
853-3000+  If your life is a hard drive,     |  830 Blythe Avenue +  Christ can be your backup.        |  Drexel Hill,
Pennsylvania19026
 

Bruce Momjian wrote:
> 
> [Charset iso-8859-1 unsupported, filtering to ASCII...]
> > The flat files are sitting at 1.9 GB right now (the primary email table).
> >
> > So I'm approaching the point where I can't backup using the COPY command.
> >
> > I'm probably using the wrong OS for this. But the performance of postgres is
> > still dazzling me (some people complain about the performance, but when I
> > see it pick 10,000 rows out of 1.4 million, sort them, and return them in a
> > second, I'm blown away).
> 
> Please see if you can create files over 2 gig.  I believe is it only OS
> bugs in dealing with exactly 2gig files that is the problem.

also note that pg_dump can write to a pipe, so you can use it thus :

> pg_dump megabase | split -b 500000k - megabase.dump.

> createdb new_megabase

> cat megabase.dump.* | psql new_megabase

to achieve space-saving, you can also pipe the thing through g(un)zip 

---------------------
Hannu