Re: Reducing ClogControlLock contention - Mailing list pgsql-hackers

From Simon Riggs
Subject Re: Reducing ClogControlLock contention
Date
Msg-id CANP8+jKXq8Xt4_o7nVUrHZu8AkPtvCL-QR_sOVa091Ft7nZ-Tg@mail.gmail.com
Whole thread Raw
In response to Re: Reducing ClogControlLock contention  (Michael Paquier <michael.paquier@gmail.com>)
Responses Re: Reducing ClogControlLock contention  (Simon Riggs <simon@2ndQuadrant.com>)
Re: Reducing ClogControlLock contention  (Amit Kapila <amit.kapila16@gmail.com>)
List pgsql-hackers
On 30 June 2015 at 08:13, Michael Paquier <michael.paquier@gmail.com> wrote:


On Tue, Jun 30, 2015 at 4:02 PM, Simon Riggs <simon@2ndquadrant.com> wrote:
ClogControlLock contention is high at commit time. This appears to be due to the fact that ClogControlLock is acquired in Exclusive mode prior to marking commit, which then gets starved by backends running TransactionIdGetStatus().

Proposal for improving this is to acquire the ClogControlLock in Shared mode, if possible.

This is safe because people checking visibility of an xid must always run TransactionIdIsInProgress() first to avoid race conditions, which will always return true for the transaction we are currently committing. As a result, we never get concurrent access to the same bits in clog, which would require a barrier.

Two concurrent writers might access the same word concurrently, so we protect against that with a new CommitLock. We could partition that by pageno also, if needed.

Could it be possible to see some performance numbers? For example with a simple pgbench script doing a bunch of tiny transactions, with many concurrent sessions (perhaps hundreds).

I'm more interested to see if people think it is safe.

This contention is masked by contention elsewhere, e.g. ProcArrayLock, so the need for testing here should come once other patches ahead of this are in.

--
Simon Riggs                http://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services

pgsql-hackers by date:

Previous
From: Michael Paquier
Date:
Subject: Missing return value checks in jsonfuncs.c
Next
From: Simon Riggs
Date:
Subject: Re: Reducing ClogControlLock contention