Re: bg worker: general purpose requirements - Mailing list pgsql-hackers

From Markus Wanner
Subject Re: bg worker: general purpose requirements
Date
Msg-id 4C9777BD.9050305@bluegap.ch
Whole thread Raw
In response to Re: bg worker: general purpose requirements  (Tom Lane <tgl@sss.pgh.pa.us>)
List pgsql-hackers
On 09/18/2010 05:43 AM, Tom Lane wrote:
> The part of that that would worry me is open files.  PG backends don't
> have any compunction about holding open hundreds of files.  Apiece.
> You can dial that down but it'll cost you performance-wise.  Last
> I checked, most Unix kernels still had limited-size FD arrays.

Thank you very much, that's a helpful hint.

I did some quick testing and managed to fork up to around 2000 backends,
at which point my (laptop) system got unresponsive. To be honest, that's
really surprising me.

(I had to increased the SHM and SEM kernel limits to be able to start
Postgres with that many processes at all. Obviously, Linux doesn't seem
to like that... on a second test I got a kernel panic)

> And as you say, ProcArray manipulations aren't going to be terribly
> happy about large numbers of idle backends, either.

Very understandable, yes.

Regards

Markus Wanner


pgsql-hackers by date:

Previous
From: Heikki Linnakangas
Date:
Subject: Re: libpq changes for synchronous replication
Next
From: "Kevin Grittner"
Date:
Subject: Do we need a ShmList implementation?