Re: realtime data inserts - Mailing list pgsql-general

From Ron Johnson
Subject Re: realtime data inserts
Date
Msg-id 1052591490.26574.161.camel@haggis
Whole thread Raw
In response to Re: realtime data inserts  (Tom Lane <tgl@sss.pgh.pa.us>)
Responses Re: realtime data inserts  (Tom Lane <tgl@sss.pgh.pa.us>)
List pgsql-general
On Sat, 2003-05-10 at 11:00, Tom Lane wrote:
> "Adam Siegel" <adam@sycamorehq.com> writes:
> > I have realtime data flowing at a rate of 500, 512 byte packets per second.
> > I want to log the info in a database table with two other columns, one for a
> > timestamp and one for a name of the packet.  The max rate I can achieve is
> > 350 inserts per second on a sun blade 2000.  The inserts are grouped in a
> > transaction and I commit every 1200 records.
>
> Have you thought about using COPY?

Generate a temporary file, and then system("COPY /tmp/foobar ...") ?

--
+---------------------------------------------------------------+
| Ron Johnson, Jr.        mailto:ron.l.johnson@cox.net          |
| Jefferson, LA  USA      http://members.cox.net/ron.l.johnson  |
|                                                               |
| The purpose of the military isn't to pay your college tuition |
| or give you a little extra income; it's to "kill people and   |
| break things".  Surprisingly, not everyone understands that.  |
+---------------------------------------------------------------+


pgsql-general by date:

Previous
From: Mathieu Arnold
Date:
Subject: Re: pg_dump && tar && /tmp
Next
From: "alex b."
Date:
Subject: odd error...