Re: High inserting by syslog - Mailing list pgsql-general

From Joshua D. Drake
Subject Re: High inserting by syslog
Date
Msg-id 1215101029.6936.14.camel@jd-laptop
Whole thread Raw
In response to High inserting by syslog  ("Valter Douglas Lisbôa Jr." <douglas@trenix.com.br>)
Responses Re: High inserting by syslog
List pgsql-general

On Thu, 2008-07-03 at 12:05 -0300, Valter Douglas Lisbôa Jr. wrote:
> Hello all, I have a perl script thats load a entire day squid log to a
> postgres table. I run it at midnight by cronjob and turns off the indexes
> before do it (turning it on after). The script works fine, but I want to
> change this to a diferent approach.

Exactly how do you turn off the indexes?

>
> I'd like to insert on the fly the log lines, so long it be generated to have
> the data on-line. But the table has some indexes and the load of lines is
> about 300.000/day, so the average inserting is 3,48/sec. I think this could
> overload the database server (i did not test yet), so if I want to create a
> no indexed table to receive the on-line inserting and do a job moving all
> lines to the main indexed table at midnight.
>
> My question is, Does exists a better solution, or this tatic is a good way to
> do this?

300,000 inserts a day isn't that much for any reasonable server.

Sincerely,

Joshua D. Drake



pgsql-general by date:

Previous
From: Oleg Bartunov
Date:
Subject: Re: Full text index without accents
Next
From: Richard Huxton
Date:
Subject: Re: High inserting by syslog