Re: Seeking performance advice and explanation for high I/O on 8.3 - Mailing list pgsql-performance

From Scott Otis
Subject Re: Seeking performance advice and explanation for high I/O on 8.3
Date
Msg-id F406B740738CB44A8BCBEF9734ECF663683F8A@albus.intand.com
Whole thread Raw
In response to Re: Seeking performance advice and explanation for high I/O on 8.3  (Magnus Hagander <magnus@hagander.net>)
Responses Re: Seeking performance advice and explanation for high I/O on 8.3
List pgsql-performance
So is there anything I can do in 8.3 to help this?  I have tried setting ' track_activities', 'track_counts' and
'autovacuum'to 'off' (which has reduced CPU and I/O a bit) - but the stats collector process is still using up a good
dealof CPU and I/O - is there any way to turn stats collecting completely off? 

Scott Otis
CIO / Lead Developer
Intand
www.intand.com


-----Original Message-----
From: Magnus Hagander [mailto:magnus@hagander.net]
Sent: Friday, September 04, 2009 1:19 AM
To: Scott Otis
Cc: Robert Haas; Ivan Voras; pgsql-performance@postgresql.org
Subject: Re: [PERFORM] Seeking performance advice and explanation for high I/O on 8.3

On Fri, Sep 4, 2009 at 08:54, Scott Otis<scott.otis@intand.com> wrote:
> Robert Haas <robertmhaas@gmail.com>:
>
>> Do you by any chance have a bazillion databases in this cluster?  Can
>> you do these?
>
>> select sum(1) from pg_database;
>
> 1555

Note that there are two features in 8.4 specifically designed to deal with the situation where you have lots of
databasesand/or lots of tables (depending on how many tables you have in each database, this would definitely qualify).
Theyboth deal with the "pgstats temp file too large generating i/o issue". 

First, it will only write the file when it's actually necessary - 8.3 and earlier will always write it.

Second, you will have the ability to move the location of the file to a different filesystem - specifically intended so
thatyou can move it off to a ramdrive. 

Could be worth investigating an upgrade for this issue alone. The fact that you don't have to struggle with tuning the
FSMin 8.4 is another thing that makes life a *lot* easier in this kind of installations. 


--
 Magnus Hagander
 Me: http://www.hagander.net/
 Work: http://www.redpill-linpro.com/

pgsql-performance by date:

Previous
From: Karl Denninger
Date:
Subject: Planner question - "bit" data types
Next
From: "Kevin Grittner"
Date:
Subject: Re: Seeking performance advice and explanation for high I/O on 8.3