Re: realtime data inserts - Mailing list pgsql-general

From Adam Siegel
Subject Re: realtime data inserts
Date
Msg-id Pine.LNX.4.44.0305121048021.6628-100000@beorn.hq.sai
Whole thread Raw
In response to Re: realtime data inserts  ("Jim C. Nasby" <jim@nasby.net>)
List pgsql-general
The copy from method (PQputline) allows me to achieve around 1000 inserts
per second.


On Sat, 10 May 2003, Jim C. Nasby wrote:

> Are you binding your insert? IE:
>
> prepare statement INSERT INTO blah VALUES (?, ?, ?);
>
> execute statement (a, b, c)
>
> Instead of just "INSERT INTO blah VALUES(a, b, c)"
>
>
> On Sat, May 10, 2003 at 11:25:16AM -0400, Adam Siegel wrote:
> > I have realtime data flowing at a rate of 500, 512 byte packets per second.
> > I want to log the info in a database table with two other columns, one for a
> > timestamp and one for a name of the packet.  The max rate I can achieve is
> > 350 inserts per second on a sun blade 2000.  The inserts are grouped in a
> > transaction and I commit every 1200 records.  I am storing the binary data
> > in a bytea.  I am using the libpq conversion function.  Not sure if that is
> > slowing me down.  But I think it is the insert not the conversion.
> >
> > Any thoughts on how to achive this goal?
>
>
>


pgsql-general by date:

Previous
From: pawlicki@mailandnews.com (John Pawlicki)
Date:
Subject: Problem Starting Postgresql after upgrade from SuSE8.1 to SuSE 8.2
Next
From: Tilo Schwarz
Date:
Subject: ERROR: Memory exhausted in AllocSetAlloc(188)