Re: PLPythonU & Out of Memory - Importing Query - Mailing list pgsql-interfaces

From Tom Lane
Subject Re: PLPythonU & Out of Memory - Importing Query
Date
Msg-id 16566.1131555155@sss.pgh.pa.us
Whole thread Raw
In response to PLPythonU & Out of Memory - Importing Query  (Jon Clements <jon.clements@trgstrata.co.uk>)
List pgsql-interfaces
Jon Clements <jon.clements@trgstrata.co.uk> writes:
> I am currently experimenting using plpythonu with postgresql 8.0 for
> Win32. It's basically a quick script that imports data from CSV files,
> but does some quite complicated data lookups and selections. The area
> in which I'm somewhat confunded is memory usage. The process
> successfully runs, but keeps climbing in memory usage relentlessly,
> successfully importing about 200k records, before the memory usage of
> postgres soars to 2gb and of course, shortly after that, grinds to a
> halt with a "Out of Memory" error.

You may have stumbled across a memory leak in plpythonu, but there's
not enough info here for anyone to investigate.  Can you put together
a self-contained test case for people to try?
        regards, tom lane


pgsql-interfaces by date:

Previous
From: Jon Clements
Date:
Subject: PLPythonU & Out of Memory - Importing Query
Next
From: Michael Fuhr
Date:
Subject: Re: PLPythonU & Out of Memory - Importing Query