pgsql: Fix false reports in pg_visibility - Mailing list pgsql-committers

From Alexander Korotkov
Subject pgsql: Fix false reports in pg_visibility
Date
Msg-id E1rkjDR-003kjA-SN@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
Fix false reports in pg_visibility

Currently, pg_visibility computes its xid horizon using the
GetOldestNonRemovableTransactionId().  The problem is that this horizon can
sometimes go backward.  That can lead to reporting false errors.

In order to fix that, this commit implements a new function
GetStrictOldestNonRemovableTransactionId().  This function computes the xid
horizon, which would be guaranteed to be newer or equal to any xid horizon
computed before.

We have to do the following to achieve this.

1. Ignore processes xmin's, because they consider connection to other databases
   that were ignored before.
2. Ignore KnownAssignedXids, because they are not database-aware. At the same
   time, the primary could compute its horizons database-aware.
3. Ignore walsender xmin, because it could go backward if some replication
   connections don't use replication slots.

As a result, we're using only currently running xids to compute the horizon.
Surely these would significantly sacrifice accuracy.  But we have to do so to
avoid reporting false errors.

Inspired by earlier patch by Daniel Shelepanov and the following discussion
with Robert Haas and Tom Lane.

Discussion: https://postgr.es/m/1649062270.289865713%40f403.i.mail.ru
Reviewed-by: Alexander Lakhin, Dmitry Koval

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/e85662df44ff47acdf5d2d413339445d60a9c30c

Modified Files
--------------
contrib/pg_visibility/Makefile                     |  1 +
contrib/pg_visibility/meson.build                  |  4 ++
contrib/pg_visibility/pg_visibility.c              | 68 ++++++++++++++++++++--
.../pg_visibility/t/001_concurrent_transaction.pl  | 47 +++++++++++++++
src/backend/storage/ipc/procarray.c                | 13 ++++-
src/include/storage/standby.h                      |  2 +
6 files changed, 129 insertions(+), 6 deletions(-)


pgsql-committers by date:

Previous
From: Alvaro Herrera
Date:
Subject: pgsql: Comment out noisy libpq_pipeline test
Next
From: Alexander Korotkov
Date:
Subject: pgsql: Fix contrib/pg_visibility/meson.build