pgsql: Ensure vacuum removes all visibly dead tuples older than OldestX - Mailing list pgsql-committers

From Melanie Plageman
Subject pgsql: Ensure vacuum removes all visibly dead tuples older than OldestX
Date
Msg-id E1sUqGT-000HlQ-8a@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
Ensure vacuum removes all visibly dead tuples older than OldestXmin

If vacuum fails to remove a tuple with xmax older than
VacuumCutoffs->OldestXmin and younger than GlobalVisState->maybe_needed,
it will loop infinitely in lazy_scan_prune(), which compares tuples'
visibility information to OldestXmin.

Starting in version 14, which uses GlobalVisState for visibility testing
during pruning, it is possible for GlobalVisState->maybe_needed to
precede OldestXmin if maybe_needed is forced to go backward while vacuum
is running. This can happen if a disconnected standby with a running
transaction older than VacuumCutoffs->OldestXmin reconnects to the
primary after vacuum initially calculates GlobalVisState and OldestXmin.

Fix this by having vacuum always remove tuples older than OldestXmin
during pruning. This is okay because the standby won't replay the tuple
removal until the tuple is removable. Thus, the worst that can happen is
a recovery conflict.

Fixes BUG# 17257

Back-patched in versions 14-17

Author: Melanie Plageman
Reviewed-by: Noah Misch, Peter Geoghegan, Robert Haas, Andres Freund, and Heikki Linnakangas
Discussion: https://postgr.es/m/CAAKRu_Y_NJzF4-8gzTTeaOuUL3CcGoXPjXcAHbTTygT8AyVqag%40mail.gmail.com

Branch
------
REL_14_STABLE

Details
-------
https://git.postgresql.org/pg/commitdiff/45ce054c02b8ac42909b8617819ff645e5c0487f

Modified Files
--------------
src/backend/access/heap/pruneheap.c  | 49 +++++++++++++++++++++++++++---------
src/backend/access/heap/vacuumlazy.c |  2 +-
src/include/access/heapam.h          |  1 +
3 files changed, 39 insertions(+), 13 deletions(-)


pgsql-committers by date:

Previous
From: Heikki Linnakangas
Date:
Subject: pgsql: Move resowner from common JitContext to LLVM specific
Next
From: Nathan Bossart
Date:
Subject: pgsql: Add overflow checks to money type.