pgsql: Avoid race in RelationBuildDesc() affecting CREATE INDEX CONCURR - Mailing list pgsql-committers

From Noah Misch
Subject pgsql: Avoid race in RelationBuildDesc() affecting CREATE INDEX CONCURR
Date
Msg-id E1meSUe-0004WX-H2@gemulon.postgresql.org
Whole thread Raw
Responses Re: pgsql: Avoid race in RelationBuildDesc() affecting CREATE INDEX CONCURR  (Tomas Vondra <tomas.vondra@enterprisedb.com>)
List pgsql-committers
Avoid race in RelationBuildDesc() affecting CREATE INDEX CONCURRENTLY.

CIC and REINDEX CONCURRENTLY assume backends see their catalog changes
no later than each backend's next transaction start.  That failed to
hold when a backend absorbed a relevant invalidation in the middle of
running RelationBuildDesc() on the CIC index.  Queries that use the
resulting index can silently fail to find rows.  Fix this for future
index builds by making RelationBuildDesc() loop until it finishes
without accepting a relevant invalidation.  It may be necessary to
reindex to recover from past occurrences; REINDEX CONCURRENTLY suffices.
Back-patch to 9.6 (all supported versions).

Noah Misch and Andrey Borodin, reviewed (in earlier versions) by Andres
Freund.

Discussion: https://postgr.es/m/20210730022548.GA1940096@gust.leadboat.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/fdd965d074d46765c295223b119ca437dbcac973

Modified Files
--------------
contrib/amcheck/t/002_cic.pl                 |  78 ++++++++++++++++
src/backend/utils/cache/inval.c              |  12 ++-
src/backend/utils/cache/relcache.c           | 115 +++++++++++++++++++++--
src/bin/pgbench/t/001_pgbench_with_server.pl | 118 +++++++----------------
src/include/utils/inval.h                    |   1 +
src/include/utils/relcache.h                 |   2 +-
src/test/perl/PostgresNode.pm                | 134 +++++++++++++++++++++++++++
src/tools/pgindent/typedefs.list             |   1 +
8 files changed, 368 insertions(+), 93 deletions(-)


pgsql-committers by date:

Previous
From: Etsuro Fujita
Date:
Subject: Re: pgsql: postgres_fdw: Move comments about elog level in (sub)abort clean
Next
From: Noah Misch
Date:
Subject: pgsql: Back-patch "Stop requiring an explicit return from perl subrouti