Re: [GENERAL] Large databases, performance - Mailing list pgsql-hackers

From Curt Sampson
Subject Re: [GENERAL] Large databases, performance
Date
Msg-id Pine.NEB.4.44.0210071127320.443-100000@angelic.cynic.net
Whole thread Raw
In response to Re: [GENERAL] Large databases, performance  ("Shridhar Daithankar" <shridhar_daithankar@persistent.co.in>)
List pgsql-hackers
On Thu, 3 Oct 2002, Shridhar Daithankar wrote:

> Our major concern remains load time as data is generated in real time and is
> expecetd in database with in specified time period.

If your time period is long enough, you can do what I do, which is
to use partial indexes so that the portion of the data being loaded
is not indexed. That will speed your loads quite a lot. Aftewards
you can either generate another partial index for the range you
loaded, or generate a new index over both old and new data, and
then drop the old index.

The one trick is that the optimizer is not very smart about combining
multiple indexes, so you often need to split your queries across
the two "partitions" of the table that have separate indexes.

> Shall I subscribe to performance?

Yes, you really ought to. The list is pgsql-performance@postgresql.org.

cjs
--
Curt Sampson  <cjs@cynic.net>   +81 90 7737 2974   http://www.netbsd.org
    Don't you know, in this new Dark Age, we're all light.  --XTC


pgsql-hackers by date:

Previous
From: Curt Sampson
Date:
Subject: Re: [GENERAL] Large databases, performance
Next
From: Tom Lane
Date:
Subject: cross-posts (was Re: [GENERAL] Large databases, performance)