pgsql: bufmgr: Support multiple in-progress IOs by using resowner - Mailing list pgsql-committers

From Andres Freund
Subject pgsql: bufmgr: Support multiple in-progress IOs by using resowner
Date
Msg-id E1pkAY7-001YE3-KQ@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
bufmgr: Support multiple in-progress IOs by using resowner

A future patch will add support for extending relations by multiple blocks at
once. To be concurrency safe, the buffers for those blocks need to be marked
as BM_IO_IN_PROGRESS. Until now we only had infrastructure for recovering from
an IO error for a single buffer. This commit extends that infrastructure to
multiple buffers by using the resource owner infrastructure.

This commit increases the size of the ResourceOwnerData struct, which appears
to have a just about measurable overhead in very extreme workloads. Medium
term we are planning to substantially shrink the size of
ResourceOwnerData. Short term the increase is small enough to not worry about
it for now.

Reviewed-by: Melanie Plageman <melanieplageman@gmail.com>
Discussion: https://postgr.es/m/20221029025420.eplyow6k7tgu6he3@awork3.anarazel.de
Discussion: https://postgr.es/m/20221029200025.w7bvlgvamjfo6z44@awork3.anarazel.de

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/12f3867f5534754c8bac5af35228d4079edc3a00

Modified Files
--------------
src/backend/access/transam/xact.c     |  4 +-
src/backend/postmaster/autovacuum.c   |  1 -
src/backend/postmaster/bgwriter.c     |  1 -
src/backend/postmaster/checkpointer.c |  1 -
src/backend/postmaster/walwriter.c    |  1 -
src/backend/storage/buffer/bufmgr.c   | 80 +++++++++++++++--------------------
src/backend/utils/resowner/resowner.c | 60 ++++++++++++++++++++++++++
src/include/storage/bufmgr.h          |  2 +-
src/include/utils/resowner_private.h  |  5 +++
9 files changed, 102 insertions(+), 53 deletions(-)


pgsql-committers by date:

Previous
From: Tom Lane
Date:
Subject: pgsql: Support "Right Anti Join" plan shapes.
Next
From: Daniel Gustafsson
Date:
Subject: pgsql: Allow to use system CA pool for certificate verification