pgsql: Fix theoretical bug in tuplesort - Mailing list pgsql-committers

From David Rowley
Subject pgsql: Fix theoretical bug in tuplesort
Date
Msg-id E1m36ZI-0006cL-EW@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
Fix theoretical bug in tuplesort

This fixes a theoretical bug in tuplesort.c which, if a bounded sort was
used in combination with a byval Datum sort (tuplesort_begin_datum), when
switching the sort to a bounded heap in make_bounded_heap(), we'd call
free_sort_tuple().  The problem was that when sorting Datums of a byval
type, the tuple is NULL and free_sort_tuple() would free the memory for it
regardless of that.  This would result in a crash.

Here we fix that simply by adding a check to see if the tuple is NULL
before trying to disassociate and free any memory belonging to it.

The reason this bug is only theoretical is that nowhere in the current
code base do we do tuplesort_set_bound() when performing a Datum sort.
However, let's backpatch a fix for this as if any extension uses the code
in this way then it's likely to cause problems.

Author: Ronan Dunklau
Discussion: https://postgr.es/m/CAApHDvpdoqNC5FjDb3KUTSMs5dg6f+XxH4Bg_dVcLi8UYAG3EQ@mail.gmail.com
Backpatch-through: 9.6, oldest supported version

Branch
------
REL_10_STABLE

Details
-------
https://git.postgresql.org/pg/commitdiff/b55e478a4c2ca506cacf33691db305a50dc43cc2

Modified Files
--------------
src/backend/utils/sort/tuplesort.c | 7 +++++--
1 file changed, 5 insertions(+), 2 deletions(-)


pgsql-committers by date:

Previous
From: David Rowley
Date:
Subject: pgsql: Fix theoretical bug in tuplesort
Next
From: David Rowley
Date:
Subject: pgsql: Fix theoretical bug in tuplesort