Re: autovacuum stress-testing our system - Mailing list pgsql-hackers

From Alvaro Herrera
Subject Re: autovacuum stress-testing our system
Date
Msg-id 1348673153-sup-4361@alvh.no-ip.org
Whole thread Raw
In response to Re: autovacuum stress-testing our system  (Euler Taveira <euler@timbira.com>)
Responses Re: autovacuum stress-testing our system  (Tom Lane <tgl@sss.pgh.pa.us>)
List pgsql-hackers
Excerpts from Euler Taveira's message of mié sep 26 11:53:27 -0300 2012:
> On 26-09-2012 09:43, Tomas Vondra wrote:

> > 5) splitting the single stat file into multiple pieces - e.g. per database,
> >    written separately, so that the autovacuum workers don't need to read all
> >    the data even for databases that don't need to be vacuumed. This might be
> >    combined with (4).
> >
> IMHO that's the definitive solution. It would be one file per database plus a
> global one. That way, the check would only read the global.stat and process
> those database that were modified. Also, an in-memory map could store that
> information to speed up the checks.

+1

> The only downside I can see is that you
> will increase the number of opened file descriptors.

Note that most users of pgstat will only have two files open (instead of
one as currently) -- one for shared, one for their own database.  Only
pgstat itself and autovac launcher would need to open pgstat files for
all databases; but both do not have a need to open other files
(arbitrary tables) so this shouldn't be a major problem.

--
Álvaro Herrera                http://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Training & Services



pgsql-hackers by date:

Previous
From: Tomas Vondra
Date:
Subject: Re: autovacuum stress-testing our system
Next
From: Marko Kreen
Date:
Subject: Re: [9.1] 2 bugs with extensions