Re: indexes greatly slowing data entry - Mailing list pgsql-general

From nconway@klamath.dyndns.org (Neil Conway)
Subject Re: indexes greatly slowing data entry
Date
Msg-id 20020626142516.GA15972@klamath.dyndns.org
Whole thread Raw
In response to Re: indexes greatly slowing data entry  ("Eric" <emayo@pozicom.net>)
List pgsql-general
On Tue, Jun 25, 2002 at 04:16:05PM -0400, Eric wrote:
> We are importing anywhere from 10,000 - 100,000 records each day and after
> this import, performance takes a major nose dive on us.
>
> And, because this data gets imported during normal business hours we can not
> tie up the server with a vacuum.  I understand 7.2 has a better vacuum but
> this doesn't seem to solve our problem because we need to be able to use the
> database during the 30 minutes it takes to import the data.

30 minutes for 100,000 records seems really high. How are you
importing the data? Are you using COPY? If you're using INSERTs,
are you putting multiple INSERTs inside a single transaction?

> There are approximately 25 users on the database at any given time.  Problem
> seems slightly amplified when users logged goes from 1 to 25.

Upgrading to 7.2 would help the VACUUM performance, at any rate.

Cheers,

Neil

--
Neil Conway <neilconway@rogers.com>
PGP Key ID: DB3C29FC



pgsql-general by date:

Previous
From: "Johnson, Shaunn"
Date:
Subject: How to run multi-processor question
Next
From: Martijn van Oosterhout
Date:
Subject: Re: unlimited undo/journaling