Re: Random server overload - Mailing list pgsql-admin

From Igor Neyman
Subject Re: Random server overload
Date
Msg-id A76B25F2823E954C9E45E32FA49D70EC42823C34@mail.corp.perceptron.com
Whole thread Raw
In response to Random server overload  (Viktor <viktor@okservers.eu>)
Responses Re: Random server overload  (Viktor <viktor@okservers.eu>)
List pgsql-admin
> -----Original Message-----
> From: pgsql-admin-owner@postgresql.org [mailto:pgsql-admin-
> owner@postgresql.org] On Behalf Of Viktor
> Sent: Tuesday, October 01, 2013 9:19 AM
> To: pgsql-admin@postgresql.org
> Subject: [ADMIN] Random server overload
>
> Hello,
>
> We are experiencing database random overloads caused by IDLE processes.
> Their count jumps from normal ~70 connections to 250-300 with high I/O (30-
> 40% wa, when normal ~ 1 % wa).
>
> The overload isn't long and lasts about 5 -10 minutes just a couple of times
> during the month.
>
> Please suggest how to debug this issue and find the cause of the overloads.
> Or mby we should tune our config file ?
>
> errorlog example:
> 2013-09-30 10:37:45 EEST FATAL:  sorry, too many clients already
> 2013-09-30 10:37:45 EEST FATAL:  remaining connection slots are reserved for
> non-replication superuser connections ...
>
> config file:
>
> max_connections = 250
> shared_buffers = 16GB
> temp_buffers = 16MB
> max_prepared_transactions = 0
> work_mem = 448MB
> maintenance_work_mem = 4GB
> max_stack_depth = 6MB
> wal_buffers = 18MB
> checkpoint_segments = 30
> checkpoint_timeout = 5min
> checkpoint_warning = 30s
> random_page_cost = 4.0
> cpu_tuple_cost = 0.01
> cpu_index_tuple_cost = 0.005
> effective_cache_size = 50GB
> default_statistics_target = 100
> autovacuum = on
>
> othr values are defaults.
>
> System:
> RAM 74 GB
> PostgreSQL 9.1.9, Debian 6
> Database size on disc: 84 GB data + 23 GB indexes. Different LVMs on RAID
> 10.
>
>
> --
> Best regards

Did you try using any kind of connection pooler, e.g. PgBouncer?
Should help.

Regards,
Igor Neyman


pgsql-admin by date:

Previous
From: Viktor
Date:
Subject: Random server overload
Next
From: Albe Laurenz
Date:
Subject: Re: Random server overload