Re: High memory usage / performance issue ( temp tables ? ) - Mailing list pgsql-sql

From gmb
Subject Re: High memory usage / performance issue ( temp tables ? )
Date
Msg-id 1408339998171-5815175.post@n5.nabble.com
Whole thread Raw
In response to Re: High memory usage / performance issue ( temp tables ? )  (Pavel Stehule <pavel.stehule@gmail.com>)
Responses Re: High memory usage / performance issue ( temp tables ? )  (Pavel Stehule <pavel.stehule@gmail.com>)
List pgsql-sql
Thanks for the replies.

I tried a couple of alternative methods over the weekend in the hope of
improving performance, but unfortunately to no avail.
One of these was to have the processing of the 500K xml files shared between
multiple threads ( multiple connections ). 
In an attempt to "force" the dropping of the temp tables , each thread
creates its own connection, run the function with XML payload and the
disconnects.
The impression I got was that the avg time per transaction still increases
as the process progresses.

My one concern with this method was locking  , which I'm unfortunately quite
unfamiliar with. 

Is it possible that locking could be a key problem when following this
multi-thread approach ?

Regards

gmb



--
View this message in context:
http://postgresql.1045698.n5.nabble.com/High-memory-usage-performance-issue-temp-tables-tp5815108p5815175.html
Sent from the PostgreSQL - sql mailing list archive at Nabble.com.



pgsql-sql by date:

Previous
From: Pavel Stehule
Date:
Subject: Re: High memory usage / performance issue ( temp tables ? )
Next
From: Pavel Stehule
Date:
Subject: Re: High memory usage / performance issue ( temp tables ? )