pgsql: Lockless StrategyGetBuffer clock sweep hot path. - Mailing list pgsql-committers

From Andres Freund
Subject pgsql: Lockless StrategyGetBuffer clock sweep hot path.
Date
Msg-id E1Y4CJJ-0006NW-6R@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
Lockless StrategyGetBuffer clock sweep hot path.

StrategyGetBuffer() has proven to be a bottleneck in a number of
buffer acquisition heavy workloads. To some degree this has already
been alleviated by 5d7962c6, but it still can be quite a heavy
bottleneck.  The problem is that in unfortunate usage patterns a
single StrategyGetBuffer() call will have to look at a large number of
buffers - in turn making it likely that the process will be put to
sleep while still holding the spinlock.

Replace most of the usage of the buffer_strategy_lock spinlock for the
clock sweep by a atomic nextVictimBuffer variable. That variable,
modulo NBuffers, is the current hand of the clock sweep. The buffer
clock-sweep then only needs to acquire the spinlock after a
wraparound. And even then only in the process that did the wrapping
around. That alleviates nearly all the contention on the relevant
spinlock, although significant contention on the cacheline can still
exist.

Reviewed-By: Robert Haas and Amit Kapila

Discussion: 20141010160020.GG6670@alap3.anarazel.de,
    20141027133218.GA2639@awork2.anarazel.de

Branch
------
master

Details
-------
http://git.postgresql.org/pg/commitdiff/d72731a70450b5e7084991b9caa15cb58a2820df

Modified Files
--------------
src/backend/postmaster/bgwriter.c     |    4 +-
src/backend/storage/buffer/freelist.c |  253 +++++++++++++++++++++++----------
src/include/storage/buf_internals.h   |    2 +-
3 files changed, 180 insertions(+), 79 deletions(-)


pgsql-committers by date:

Previous
From: Andres Freund
Date:
Subject: pgsql: Add capability to suppress CONTEXT: messages to elog machinery.
Next
From: Tom Lane
Date:
Subject: pgsql: Temporarily revert "Move pg_lzcompress.c to src/common."