Optimizing large data loads - Mailing list pgsql-general

From John Wells
Subject Optimizing large data loads
Date
Msg-id 57890.66.192.236.118.1123244718.squirrel@devsea.com
Whole thread Raw
Responses Re: Optimizing large data loads  (Richard Huxton <dev@archonet.com>)
List pgsql-general
Hi guys,

We have a Java process that uses Hibernate to load approximately 14 GB of
data.  One a dual-proc 2.4 GHZ Xeon with 2048 MB RAM, it's currently
taking over 13 hours to load (PostgreSQL 7.4.8).  We're flushing from
hibernate every 50 records.

I've turned fsync to false in postgresql.conf, and we've turned autocommit
off in our code.  Is there anything else I could try to temporarily speed
up inserts?

Thanks very much for your help.

John


pgsql-general by date:

Previous
From: David Goodenough
Date:
Subject: Re: Does preparing statements other than selects help performance?
Next
From: Stephane Bortzmeyer
Date:
Subject: Re: wanting to use postgres with python - WHAT am I doing wrong?????? AGGGHHHH