Re: java.lang.OutOfMemory Exception with a large number of inserts - Mailing list pgsql-interfaces

From Arsalan Zaidi
Subject Re: java.lang.OutOfMemory Exception with a large number of inserts
Date
Msg-id 008101c14fe0$74c4aec0$4301a8c0@directi.com
Whole thread Raw
In response to java.lang.OutOfMemory Exception with a large number of inserts  ("Arsalan Zaidi" <azaidi@directi.com>)
List pgsql-interfaces

Would it help if I moved this particular bit of code on to the server side
as a server side function?

Would there be a significant increase in speed/efficiency?

Thanks in advance.

--Arsalan

> break up you insert into several trunks.
>
>
> Arsalan Zaidi wrote:
>
> > Hi.
> >
> > At one point in my program, I was inserting a large number of rows
> > (~600,000) using a prepared statement. Here are some things I noticed.
> >
> > 1. It's very slow! :-)
> > 2. Initially, the cpu monitor shows a high level of cpu utilisation, but
> > this slowly drops off with a blip every second or so. Basically, things
slow
> > down as the process chugs along.
> > 3. I eventually get a java.Lang.OutOfMemory exception after approx
1:00 -
> > 1:30 hrs.
> >
> > I tried running the JVM with heap size set to 50 Mbytes. I still get the
out
> > of mem error.
> >
> > I can't use the 'load' command instead of individual inserts.
> >
> > Is there a faster/better way? Any ideas on how I can get rid of the out
of
> > mem errors?
> >
> > Thanks in advance
> >
> > --Arsalan
> > -------------------------------------------------
> > WAR IS PEACE
> > FREEDOM IS SLAVERY
> > IGNORANCE IS STRENGTH
> > --1984
> >
> > ---------------------------(end of broadcast)---------------------------
> > TIP 6: Have you searched our list archives?
> >
> > http://archives.postgresql.org
>
>


pgsql-interfaces by date:

Previous
From: Michael Meskes
Date:
Subject: Re: libECPG: Warning: get descriptor: 7.1 and 7.2 arenot binary compatible (yet)
Next
From: Tom Lane
Date:
Subject: Re: libECPG: Warning: get descriptor: 7.1 and 7.2 arenot