Re: Postgres and really huge tables - Mailing list pgsql-performance

From Tom Lane
Subject Re: Postgres and really huge tables
Date
Msg-id 6593.1169157178@sss.pgh.pa.us
Whole thread Raw
In response to Postgres and really huge tables  (Brian Hurt <bhurt@janestcapital.com>)
Responses Re: [pgsql-advocacy] Postgres and really huge tables  (Oleg Bartunov <oleg@sai.msu.su>)
List pgsql-performance
Brian Hurt <bhurt@janestcapital.com> writes:
> Is there any experience with Postgresql and really huge tables?  I'm
> talking about terabytes (plural) here in a single table.

The 2MASS sky survey point-source catalog
http://www.ipac.caltech.edu/2mass/releases/allsky/doc/sec2_2a.html
is 470 million rows by 60 columns; I don't have it loaded up but
a very conservative estimate would be a quarter terabyte.  (I've
got a copy of the data ... 5 double-sided DVDs, gzipped ...)
I haven't heard from Rae Stiening recently but I know he's been using
Postgres to whack that data around since about 2001 (PG 7.1 or so,
which is positively medieval compared to current releases).  So at
least for static data, it's certainly possible to get useful results.
What are your processing requirements?

            regards, tom lane

pgsql-performance by date:

Previous
From: Chris Mair
Date:
Subject: Re: [pgsql-advocacy] Postgres and really huge tables
Next
From: "Jeremy Haile"
Date:
Subject: Re: Autoanalyze settings with zero scale factor