pgsql: Fix corner case with 16kB-long decompression in pgcrypto, take 2 - Mailing list pgsql-committers

From Michael Paquier
Subject pgsql: Fix corner case with 16kB-long decompression in pgcrypto, take 2
Date
Msg-id E1jzxAp-0006tc-Ve@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
Fix corner case with 16kB-long decompression in pgcrypto, take 2

A compressed stream may end with an empty packet.  In this case
decompression finishes before reading the empty packet and the
remaining stream packet causes a failure in reading the following
data.  This commit makes sure to consume such extra data, avoiding a
failure when decompression the data.  This corner case was reproducible
easily with a data length of 16kB, and existed since e94dd6a.  A cheap
regression test is added to cover this case based on a random,
incompressible string.

The first attempt of this patch has allowed to find an older failure
within the compression logic of pgcrypto, fixed by b9b6105.  This
involved SLES 15 with z390 where a custom flavor of libz gets used.
Bonus thanks to Mark Wong for providing access to the specific
environment.

Reported-by: Frank Gagnepain
Author: Kyotaro Horiguchi, Michael Paquier
Reviewed-by: Tom Lane
Discussion: https://postgr.es/m/16476-692ef7b84e5fb893@postgresql.org
Backpatch-through: 9.5

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/a3ab7a707d9eda4b2162273348cba52252c0f0c9

Modified Files
--------------
contrib/pgcrypto/expected/pgp-compression.out | 30 +++++++++++++++++++++++++++
contrib/pgcrypto/pgp-compress.c               | 21 +++++++++++++++++++
contrib/pgcrypto/sql/pgp-compression.sql      | 21 +++++++++++++++++++
3 files changed, 72 insertions(+)


pgsql-committers by date:

Previous
From: Michael Paquier
Date:
Subject: pgsql: Fix handling of structure for bytea data type in ECPG
Next
From: Michael Paquier
Date:
Subject: pgsql: Fix corner case with 16kB-long decompression in pgcrypto, take 2