Make pg_prewarm, autoprewarm yield for waiting DDL - Mailing list pgsql-hackers

From SATYANARAYANA NARLAPURAM
Subject Make pg_prewarm, autoprewarm yield for waiting DDL
Date
Msg-id CAHg+QDfdoR=7iqEAvLW9qtzV0Sx1wp2FuALeamqcCdiVEmMF-Q@mail.gmail.com
Whole thread Raw
Responses Re: Make pg_prewarm, autoprewarm yield for waiting DDL
List pgsql-hackers
Both pg_prewarm() and the autoprewarm background worker hold AccessShareLock on the target relation for the entire duration of prewarming. On large tables this can take a long time, which means
that any DDL that needs a stronger lock (TRUNCATE, DROP TABLE, ALTER TABLE, etc.) is blocked for the full duration.

VACUUM already solves this same problem during heap truncation: it periodically calls LockHasWaitersRelation() and backs off when a conflicting waiter is detected (see lazy_truncate_heap()).

The attached patch applies the same pattern to pg_prewarm and autoprewarm. Every 1024 blocks, each code path checks for a waiter and if found then the lock is released so that the DDL can proceed. Patch handles the relation truncation, drop cases by emitting an error message. If the relation was only partially truncated, the endpoint is adjusted downward and prewarming continues.
When no DDL is waiting, the only overhead is one lock-table probe per 1024 blocks.

While developing this patch I discovered that LockHasWaiters() crashes with a segfault when the lock in question was acquired via the fast-path optimization, details in [1].

The patch includes a TAP test (t/002_lock_yield.pl) that exercises the TRUNCATE and DROP TABLE scenarios using injection points.

Thanks,
Attachment

pgsql-hackers by date:

Previous
From: Matthias van de Meent
Date:
Subject: Re: SQL-level pg_datum_image_equal
Next
From: Melanie Plageman
Date:
Subject: Re: Buffer locking is special (hints, checksums, AIO writes)