Re: realtime data inserts - Mailing list pgsql-general

From Jim C. Nasby
Subject Re: realtime data inserts
Date
Msg-id 20030510120833.K66185@flake.decibel.org
Whole thread Raw
In response to realtime data inserts  ("Adam Siegel" <adam@sycamorehq.com>)
Responses Re: realtime data inserts
List pgsql-general
Are you binding your insert? IE:

prepare statement INSERT INTO blah VALUES (?, ?, ?);

execute statement (a, b, c)

Instead of just "INSERT INTO blah VALUES(a, b, c)"


On Sat, May 10, 2003 at 11:25:16AM -0400, Adam Siegel wrote:
> I have realtime data flowing at a rate of 500, 512 byte packets per second.
> I want to log the info in a database table with two other columns, one for a
> timestamp and one for a name of the packet.  The max rate I can achieve is
> 350 inserts per second on a sun blade 2000.  The inserts are grouped in a
> transaction and I commit every 1200 records.  I am storing the binary data
> in a bytea.  I am using the libpq conversion function.  Not sure if that is
> slowing me down.  But I think it is the insert not the conversion.
>
> Any thoughts on how to achive this goal?


--
Jim C. Nasby (aka Decibel!)                    jim@nasby.net
Member: Triangle Fraternity, Sports Car Club of America
Give your computer some brain candy! www.distributed.net Team #1828

Windows: "Where do you want to go today?"
Linux: "Where do you want to go tomorrow?"
FreeBSD: "Are you guys coming, or what?"


pgsql-general by date:

Previous
From: Tom Lane
Date:
Subject: Re: realtime data inserts
Next
From: "Jim C. Nasby"
Date:
Subject: Re: pg_dump && tar && /tmp