Re: Pooling in Core WAS: Need help in performance tuning. - Mailing list pgsql-performance

From Josh Berkus
Subject Re: Pooling in Core WAS: Need help in performance tuning.
Date
Msg-id 4C37CBFB.1000800@agliodbs.com
Whole thread Raw
In response to Re: Need help in performance tuning.  ("Kevin Grittner" <Kevin.Grittner@wicourts.gov>)
Responses Re: Pooling in Core WAS: Need help in performance tuning.
Re: Pooling in Core WAS: Need help in performance tuning.
List pgsql-performance
> It *is* the last place you want to put it, but putting it there can
> be much better than not putting it *anywhere*, which is what we've
> often seen.

Well, what you proposed is an admission control mechanism, which is
*different* from a connection pool, although the two overlap.  A
connection pool solves 4 problems when it's working:

a) limiting the number of database server processes
b) limiting the number of active concurrent queries
c) reducing response times for allocating a new connection
d) allowing management of connection routes to the database
(redirection, failover, etc.)

What you were proposing is only (b).  While (b) alone is better than
nothing, it only solves some kinds of problems.  Database backend
processes are *not* free, and in general when I see users with "too many
connections" failures they are not because of too many concurrent
queries, but rather because of too many idle connections (I've seen up
to 1800 on a server).  Simply adding (b) for crappy applications would
make the problem worse, not better, because of the large number of
pending queries which the developer would fail to deal with, or monitor.

So while adding (b) to core alone would be very useful for some users,
ironically it's generally for the more advanced users which are not the
ones we're trying to help on this thread.

--
                                  -- Josh Berkus
                                     PostgreSQL Experts Inc.
                                     http://www.pgexperts.com

pgsql-performance by date:

Previous
From: Mark Kirkwood
Date:
Subject: Re: Need help in performance tuning.
Next
From: Craig Ringer
Date:
Subject: Re: Pooling in Core WAS: Need help in performance tuning.