Re: Insert statements really slow - Mailing list pgsql-general

From Waller, David
Subject Re: Insert statements really slow
Date
Msg-id DEC16B2C3347C64BAC476767D0B36229038ACDAB@JACO.sccompanies.com
Whole thread Raw
In response to Re: Insert statements really slow  ("Merlin Moncure" <mmoncure@gmail.com>)
List pgsql-general
I have found some errors in my perl script that was slowing everything
down.  I too am now seeing similar speed between postgresql and mysql.

Sorry for the confusion.

Dave

-----Original Message-----
From: Merlin Moncure [mailto:mmoncure@gmail.com]
Sent: Tuesday, November 13, 2007 8:44 PM
To: Waller, David
Cc: pgsql-general@postgresql.org
Subject: Re: [GENERAL] Insert statements really slow

On Nov 9, 2007 12:53 PM, Waller, David <Waller_D@imsdm.com> wrote:
> I have an application that I am porting from MySQL to PostgreSQL and I

> am working on the import Perl script that process the data.
>
> The data is web log data and each line has a variable amount of the
> fields (mostly because of cookies) so I am using a lot of insert
statements.
>
> In MySQL I go through a file in about 2 minutes and it is taking about

> 30 in PG.  I have removed all but the primary key index and have done
> a BEGIN and COMMIT after turning off AUTOCOMMIT.

can you give us a better idea of the # records/sec we are talking about
here?  mysql and pg are usually pretty close in insert performance.
maybe there is something fishy going on.

merlin

pgsql-general by date:

Previous
From: Alvaro Herrera
Date:
Subject: Re: autovacuum and reindex
Next
From: Tom Lane
Date:
Subject: Re: Using generate_series to create a unique ID in a query?