pgsql: Fix incorrect handling of NULL index entries in indexed ROW() co - Mailing list pgsql-committers

From Tom Lane
Subject pgsql: Fix incorrect handling of NULL index entries in indexed ROW() co
Date
Msg-id E1adk8q-0002VJ-Bb@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
Fix incorrect handling of NULL index entries in indexed ROW() comparisons.

An index search using a row comparison such as ROW(a, b) > ROW('x', 'y')
would stop upon reaching a NULL entry in the "b" column, ignoring the
fact that there might be non-NULL "b" values associated with later values
of "a".  This happens because _bt_mark_scankey_required() marks the
subsidiary scankey for "b" as required, which is just wrong: it's for
a column after the one with the first inequality key (namely "a"), and
thus can't be considered a required match.

This bit of brain fade dates back to the very beginnings of our support
for indexed ROW() comparisons, in 2006.  Kind of astonishing that no one
came across it before Glen Takahashi, in bug #14010.

Back-patch to all supported versions.

Note: the given test case doesn't actually fail in unpatched 9.1, evidently
because the fix for bug #6278 (i.e., stopping at nulls in either scan
direction) is required to make it fail.  I'm sure I could devise a case
that fails in 9.1 as well, perhaps with something involving making a cursor
back up; but it doesn't seem worth the trouble.

Branch
------
REL9_2_STABLE

Details
-------
http://git.postgresql.org/pg/commitdiff/c8e059724f35b32e4c54d24349a2e3675067e38c

Modified Files
--------------
src/backend/access/nbtree/nbtutils.c   | 31 ++++++++-----------------------
src/test/regress/expected/rowtypes.out | 23 +++++++++++++++++++++++
src/test/regress/sql/rowtypes.sql      | 15 +++++++++++++++
3 files changed, 46 insertions(+), 23 deletions(-)


pgsql-committers by date:

Previous
From: Tom Lane
Date:
Subject: pgsql: Fix incorrect handling of NULL index entries in indexed ROW() co
Next
From: Tom Lane
Date:
Subject: pgsql: Fix incorrect handling of NULL index entries in indexed ROW() co