Performance Problem - Mailing list pgsql-general

From Adam Sherman
Subject Performance Problem
Date
Msg-id 62900000.1052747832@saturn
Whole thread Raw
Responses Re: Performance Problem  (Bruno Wolff III <bruno@wolff.to>)
List pgsql-general
I am trying to isolate a performance problem I'm having.

I have some code that does something like this, iterating through a list:


BEGIN
while(list)
lookup for existing entry (SELECT)
if not, INSERT
if yes, UPDATE
log a message
COMMIT

With approx. 30K items the process takes way too long. On the order of 10+
minutes.

I notice that the process seems to slow down as it completes more and more
items. ie, the first 10K takes just a few moments while the last 10K takes
most of the time. Note that I'm running test where the only existing
entries will have been inserted in the same transaction.

I need to know if the bottleneck is PG or higher up so I can go hunting
there.

Thanks,

A.

--
Adam Sherman
Tritus CG Inc.
http://www.tritus.ca/
+1 (613) 797-6819


pgsql-general by date:

Previous
From: Doug McNaught
Date:
Subject: Re: Caching Websites
Next
From: Jason Hihn
Date:
Subject: Arrays with MS Access?