[GENERAL] Current best practice for maximum shared_buffers settings on bighardware? - Mailing list pgsql-general

From Bill Moran
Subject [GENERAL] Current best practice for maximum shared_buffers settings on bighardware?
Date
Msg-id 20170524082415.1dd67c9f17da427135616324@potentialtech.com
Whole thread Raw
Responses Re: [GENERAL] Current best practice for maximum shared_bufferssettings on big hardware?  (Justin Pryzby <pryzby@telsasoft.com>)
Re: [GENERAL] Current best practice for maximum shared_bufferssettings on big hardware?  (Scott Marlowe <scott.marlowe@gmail.com>)
List pgsql-general
A few years ago, I was working with "big" servers. At least, they were
big for that age, with *128G* of RAM!!!1 Holy mackeral, right?!!?

Anyway, at that time, I tried allocating 64G to shared buffers and we
had a bunch of problems with inconsistent performance, including "stall"
periods where the database would stop responding for 2 or 3 seconds.
After trying all sorts of tuning options that didn't help, the problem
finally went away after reducing shared_buffers to 32G. I speculated, at
the time, that the shared buffer code hit performance issues managing
that much memory, but I never had the opportunity to really follow up
on it.

Now, this was back in 2012 or thereabouts. Seems like another lifetime.
Probably PostgreSQL 9.2 at that time.

Nowadays, 128G is a "medium sized" server. I just got access to one
with 775G. It would appear that I could order from Dell with 1.5T of
RAM if I'm willing to sell my house ...

Yet, all the docs and advice I'm able to find online seem to have been
written pre 2008 and say things like "if your server has more than 1G
of RAM ..."

I feel like it's time for a documentation update ;) But I, personally
don't have the experience recently enough to know what sort of
recommendations to make.

What are people's experience with modern versions of Postgres on hardware
this size? Do any of the experts have specific recommendations on large
shared_buffers settings? Any developers care to comment on any work
that's been done since 2012 to make large values work better?

--
Bill Moran <wmoran@potentialtech.com>


pgsql-general by date:

Previous
From: Devrim Gündüz
Date:
Subject: Re: [GENERAL] Installing module for 9.6, not 9.2, on Centos?
Next
From: stevenchang1213
Date:
Subject: Re: [GENERAL] Current best practice for maximum shared_bufferssettings on big hardware?