Re: increasingly slow insert/copy performance - Mailing list pgsql-general

From Scott Marlowe
Subject Re: increasingly slow insert/copy performance
Date
Msg-id 1113858697.20921.536.camel@state.g2switchworks.com
Whole thread Raw
In response to increasingly slow insert/copy performance  (Todd Underwood <todd@renesys.com>)
List pgsql-general
On Sun, 2005-04-17 at 09:17, Todd Underwood wrote:
> howdy,
>
> i'm by no means a postgres expert, so i'm probably making a dumb
> mistake, but this is v. troubling.
>
> we have a script that bulk-uploads about 45K rows.  we do this via
> perl DBI using the COPY functionality.
>
> the problem is that we do this about once per 5 minutes and the time
> it takes to do the operation steadily increases (going from about 5s
> to over 5m over the course of 24 hrs).  the table has one primary key
> (so hence one index), that we drop and recreate during the bulk load.

I'm guessing that either you aren't vacuuming enough, or your fsm
settings are too low.

What does vacuum verbose say?  What are your fsm settings?  Does 'vacuum
full <tablename>' fix the problem?

Do NOT TURN OFF FSYNC.

pgsql-general by date:

Previous
From: Lorenzo Thurman
Date:
Subject: pg_dump fails
Next
From: Tom Lane
Date:
Subject: Re: increasingly slow insert/copy performance