pgsql: bufmgr: Improve stats when a buffer is read in concurrently - Mailing list pgsql-committers

From Andres Freund
Subject pgsql: bufmgr: Improve stats when a buffer is read in concurrently
Date
Msg-id E1tvPoA-000D6g-0k@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
bufmgr: Improve stats when a buffer is read in concurrently

Previously we would have the following inaccuracies when a backend tried to
read in a buffer, but that buffer was read in concurrently by another backend:
- the read IO was double-counted in the global buffer access stats (pgBufferUsage)
- the buffer hit was not accounted for in:
  - global buffer access statistics
  - pg_stat_io
  - relation level IO stats
  - vacuum cost balancing

While trying to read in a buffer that is concurrently read in by another
backend is not a common occurrence, it's also not that rare, e.g. due to
concurrent sequential scans on the same relation.  This scenario has become
more likely in PG 17, due to the introducing of read streams, which can pin
multiple buffers before calling StartBufferIO() for all the buffers.

This behaviour has historically grown, but there doesn't seem to be any reason
to continue with the wrong accounting.

Reviewed-by: Melanie Plageman <melanieplageman@gmail.com>
Discussion: https://postgr.es/m/CAAKRu_Zk-B08AzPsO-6680LUHLOCGaNJYofaxTFseLa=OepV1g@mail.gmail.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/202b12774d092baf7e5d3309aa3cb0cd1e8a606b

Modified Files
--------------
src/backend/storage/buffer/bufmgr.c | 37 ++++++++++++++++++++++---------------
1 file changed, 22 insertions(+), 15 deletions(-)


pgsql-committers by date:

Previous
From: David Rowley
Date:
Subject: Re: pgsql: Add vacuum_truncate configuration parameter.
Next
From: David Rowley
Date:
Subject: pgsql: Simplify EXPLAIN code for Memoize