E.22. Release 15.4
Release date: 2023-08-10
This release contains a variety of fixes from 15.3. For information about new features in major release 15, see Section E.26.
E.22.1. Migration to Version 15.4
A dump/restore is not required for those running 15.X.
However, if you use BRIN indexes, it may be advisable to reindex them; see the third changelog entry below.
Also, if you are upgrading from a version earlier than 15.1, see Section E.25.
E.22.2. Changes
Disallow substituting a schema or owner name into an extension script if the name contains a quote, backslash, or dollar sign (Noah Misch) §
This restriction guards against SQL-injection hazards for trusted extensions.
The PostgreSQL Project thanks Micah Gates, Valerie Woolard, Tim Carey-Smith, and Christoph Berg for reporting this problem. (CVE-2023-39417)
Fix
MERGE
to enforce row security policies properly (Dean Rasheed) §When
MERGE
performs anUPDATE
action, it should enforce anyUPDATE
orSELECT
RLS policies defined on the target table, to be consistent with the way that a plainUPDATE
with aWHERE
clause works. Instead it was enforcingINSERT
RLS policies for bothINSERT
andUPDATE
actions.In addition, when
MERGE
performs aDO NOTHING
action, it applied the target table'sDELETE
RLS policies to existing rows, even though those rows are not being deleted. While it's not a security problem, this could result in unwanted errors.The PostgreSQL Project thanks Dean Rasheed for reporting this problem. (CVE-2023-39418)
Fix confusion between empty (no rows) ranges and all-NULL ranges in BRIN indexes, as well as incorrect merging of all-NULL summaries (Tomas Vondra) § §
Each of these oversights could result in forgetting that a BRIN index range contains any NULL values, potentially allowing subsequent queries that should return NULL values to miss doing so.
This fix will not in itself correct faulty BRIN entries. It's recommended to
REINDEX
any BRIN indexes that may be used to search for nulls.Avoid leaving a corrupted database behind when
DROP DATABASE
is interrupted (Andres Freund) §If
DROP DATABASE
was interrupted after it had already begun taking irreversible steps, the target database remained accessible (because the removal of itspg_database
row would roll back), but it would have corrupt contents. Fix by marking the database as inaccessible before we begin to perform irreversible operations. A failure after that will leave the database still partially present, but nothing can be done with it except to issue anotherDROP DATABASE
.Ensure that partitioned indexes are correctly marked as valid or not at creation (Michael Paquier) §
If a new partitioned index matches an existing but invalid index on one of the partitions, the partitioned index could end up being marked valid prematurely. This could lead to misbehavior or assertion failures in subsequent queries on the partitioned table.
Ignore invalid child indexes when matching partitioned indexes to child indexes during
ALTER TABLE ATTACH PARTITION
(Michael Paquier) §Such an index will now be ignored, and a new child index created instead.
Fix possible failure when marking a partitioned index valid after all of its partitions have been attached (Michael Paquier) §
The update of the index's
pg_index
entry could use stale data for other columns. One reported symptom is an “attempted to update invisible tuple” error.Fix
ALTER EXTENSION SET SCHEMA
to complain if the extension contains any objects outside the extension's schema (Michael Paquier, Heikki Linnakangas) §Erroring out if the extension contains objects in multiple schemas was always intended; but the check was mis-coded so that it would fail to detect some cases, leading to surprising behavior.
Fix tracking of tables' access method dependencies (Michael Paquier) §
ALTER TABLE ... SET ACCESS METHOD
failed to update relevantpg_depend
entries when changing a table's access method. When using non-built-in access methods, this creates a risk that an access method could be dropped even though tables still depend on it. This fix corrects the logic inALTER TABLE
, but it will not adjust any already-missingpg_depend
entries.Don't use partial unique indexes for uniqueness proofs in the planner (David Rowley) §
This could give rise to incorrect plans, since the presumed uniqueness of rows read from a table might not hold if the index in question isn't used to scan the table.
Don't Memoize lateral joins with volatile join conditions (Richard Guo) §
Applying Memoize to a sub-plan that contains volatile filter conditions is likely to lead to wrong answers. The check to avoid doing this missed some cases that can arise when using
LATERAL
.Avoid producing incorrect plans for foreign joins with pseudoconstant join clauses (Etsuro Fujita) §
The planner currently lacks support for attaching pseudoconstant join clauses to a pushed-down remote join, so disable generation of remote joins in such cases. (A better solution will require ABI-breaking changes of planner data structures, so it will have to wait for a future major release.)
Correctly handle sub-SELECTs in RLS policy expressions and security-barrier views when expanding rule actions (Tom Lane) §
Fix race conditions in conflict detection for
SERIALIZABLE
isolation mode (Thomas Munro) § § §Conflicts could be missed when using bitmap heap scans, when using GIN indexes, and when examining an initially-empty btree index. All these cases could lead to serializability failures due to improperly allowing conflicting transactions to commit.
Fix misbehavior of EvalPlanQual checks with inherited or partitioned target tables (Tom Lane) §
This oversight could lead to update or delete actions in
READ COMMITTED
isolation mode getting performed when they should have been skipped because of a conflicting concurrent update.Fix hash join with an inner-side hash key that contains Params coming from an outer nested loop (Tom Lane) §
When rescanning the join after the values of such Params have changed, we must rebuild the hash table, but neglected to do so. This could result in missing join output rows.
Fix intermittent failures when trying to update a field of a composite column (Tom Lane) §
If the overall value of the composite column is wide enough to require out-of-line toasting, then an unluckily-timed cache flush could cause errors or server crashes.
Prevent query-lifespan memory leaks in some
UPDATE
queries with triggers (Tomas Vondra) § §Prevent query-lifespan memory leaks when an Incremental Sort plan node is rescanned (James Coleman, Laurenz Albe, Tom Lane) §
Accept fractional seconds in the input to
jsonpath
'sdatetime()
method (Tom Lane) §Prevent stack-overflow crashes with very complex text search patterns (Tom Lane) §
Allow tokens up to 10240 bytes long in
pg_hba.conf
andpg_ident.conf
(Tom Lane) §The previous limit of 256 bytes has been found insufficient for some use-cases.
Ensure that all existing placeholders are checked for matches when an extension declares its GUC prefix to be reserved (Karina Litskevich, Ekaterina Sokolova) §
Faulty loop logic could cause some entries to be skipped.
Fix mishandling of C++ out-of-memory conditions (Heikki Linnakangas) §
If JIT is in use, running out of memory in a C++
new
call would lead to a PostgreSQL FATAL error, instead of the expected C++ exception.Fix rare null-pointer crash in
plancache.c
(Tom Lane) §Avoid leaking a stats entry for a subscription when it is dropped (Masahiko Sawada) §
Avoid losing track of possibly-useful shared memory segments when a page free results in coalescing ranges of free space (Dongming Liu) §
Ensure that the segment is moved into the appropriate “bin” for its new amount of free space, so that it will be found by subsequent searches.
Allow
VACUUM
to continue after detecting certain types of b-tree index corruption (Peter Geoghegan) § §If an invalid sibling-page link is detected, log the issue and press on, rather than throwing an error as before. Nothing short of
REINDEX
will fix the broken index, but preventingVACUUM
from completing until that is done risks making matters far worse.Ensure that
WrapLimitsVacuumLock
is released afterVACUUM
detects invalid data inpg_database
.datfrozenxid
orpg_database
.datminmxid
(Andres Freund) §Failure to release this lock could lead to a deadlock later, although the lock would be cleaned up if the session exits or encounters some other error.
Avoid double replay of prepared transactions during crash recovery (suyu.cmj, Michael Paquier) § §
After a crash partway through a checkpoint with some two-phase transaction state data already flushed to disk by this checkpoint, crash recovery could attempt to replay the prepared transaction(s) twice, leading to a fatal error such as “lock is already held” in the startup process.
Ensure that a newly created, but still empty table is
fsync
'ed at the next checkpoint (Heikki Linnakangas) §Without this, if there is an operating system crash causing the empty file to disappear, subsequent operations on the table might fail with “could not open file” errors.
Ensure that creation of the init fork of an unlogged index is WAL-logged (Heikki Linnakangas) §
While an unlogged index's main data fork is not WAL-logged, its init fork should be, to ensure that we have a consistent state to restore the index to after a crash. This step was missed if the init fork contains no data, which is a case not used by any standard index AM; but perhaps some extension behaves that way.
Silence bogus “missing contrecord” errors (Thomas Munro) §
Treat this case as plain end-of-WAL to avoid logging inaccurate complaints from pg_waldump and walsender.
Fix overly strict assertion in
jsonpath
code (David Rowley) §This assertion failed if a query applied the
.type()
operator to alike_regex
result. There was no bug in non-assert builds.Avoid assertion failure when processing an empty statement via the extended query protocol in an already-aborted transaction (Tom Lane) §
Avoid assertion failure when the
stats_fetch_consistency
setting is changed intra-transaction (Kyotaro Horiguchi) §Fix
contrib/fuzzystrmatch
's Soundexdifference()
function to handle empty input sanely (Alexander Lakhin, Tom Lane) §An input string containing no alphabetic characters resulted in unpredictable output.
Tighten whitespace checks in
contrib/hstore
input (Evan Jones) §In some cases, characters would be falsely recognized as whitespace and hence discarded.
Disallow oversize input arrays with
contrib/intarray
'sgist__int_ops
index opclass (Ankit Kumar Pandey, Alexander Lakhin) §Previously this code would report a
NOTICE
but press on anyway, creating an invalid index entry that presents a risk of crashes when the index is read.Avoid useless double decompression of GiST index entries in
contrib/intarray
(Konstantin Knizhnik, Matthias van de Meent, Tom Lane) §Fix
contrib/pageinspect
'sgist_page_items()
function to work when there are included index columns (Alexander Lakhin, Michael Paquier) §Previously, if the index has included columns,
gist_page_items()
would fail to display those values on index leaf pages, or crash outright on non-leaf pages.In psql, ignore the
PSQL_WATCH_PAGER
environment variable when stdin/stdout are not a terminal (Tom Lane) §This corresponds to the treatment of
PSQL_PAGER
in commands besides\watch
.Fix pg_dump to correctly handle new-style SQL-language functions whose bodies require parse-time dependencies on unique indexes (Tom Lane) §
Such cases can arise from
GROUP BY
andON CONFLICT
clauses, for example. The function must then be postponed until after the unique index in the dump output, but pg_dump did not do that and instead printed a warning about “could not resolve dependency loop”.Improve pg_dump's display of details about dependency-loop problems (Tom Lane) §
Avoid crash in pgbench with an empty pipeline and prepared mode (Álvaro Herrera) §
Ensure that
pg_index
.indisreplident
is kept up-to-date in relation cache entries (Shruthi Gowda) §This value could be stale in some cases. There is no core code that relies on the relation cache's copy, so this is only a latent bug as far as Postgres itself is concerned; but there may be extensions for which it is a live bug.
Fix make_etags script to work with non-Exuberant ctags (Masahiko Sawada) §