Re: Stats collector eats my CPU - Mailing list pgsql-general

From Merlin Moncure
Subject Re: Stats collector eats my CPU
Date
Msg-id b42b73150810080634k15aba383u8baf818d6a896972@mail.gmail.com
Whole thread Raw
In response to Re: Stats collector eats my CPU  (Tom Lane <tgl@sss.pgh.pa.us>)
Responses Re: Stats collector eats my CPU  (Simon Riggs <simon@2ndQuadrant.com>)
List pgsql-general
On Wed, Oct 8, 2008 at 9:05 AM, Tom Lane <tgl@sss.pgh.pa.us> wrote:
> wstrzalka <wstrzalka@gmail.com> writes:
>> the 15483 process is stats collector. At the moment server is almost
>> idle but the stats collector is constantly taking 15-17% of CPU.
>
>> I don't know if it matters at all, but maybe the reason is that the
>> cluster is very large in the term of relation number (many schemes
>> with identical table set).
>
>> select count(*) from pg_class;
>>  count
>> --------
>>  257477
>
> Ouch.  You might want to consider a schema redesign.  Usually, if you've
> got a lot of tables with the same column-set, it's better to combine
> them into one big table with an additional key column.
>
> I'm sure the stats collector runtime is directly tied to having so many
> tables --- it's trying to keep stats on each one of them individually.

Unfortunately there are other competing issues with huge tables, like
long vacuums.  There's been some work to mitigate this, but we haven't
turned the corner yet.  IMNSHO, though, table partitioning is a
feature that should be used...cautiously.

merlin

pgsql-general by date:

Previous
From: "Grzegorz Jaśkiewicz"
Date:
Subject: 8.4 RPMs
Next
From: "Andy Dale"
Date:
Subject: Re: 8.4 RPMs