pgsql: Fix comments that claimed that mblen() only looks at firstbyte. - Mailing list pgsql-committers

From Heikki Linnakangas
Subject pgsql: Fix comments that claimed that mblen() only looks at firstbyte.
Date
Msg-id E1gn110-0005FJ-2T@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
Fix comments that claimed that mblen() only looks at first byte.

GB18030's mblen() function looks at the first and the second byte of the
multibyte character, to determine its length. copy.c had made the
assumption that mblen() only looks at the first byte, but it turns out to
work out fine, because of the way the GB18030 encoding works. COPY will
see a 4-byte encoded character as two 2-byte encoded characters, which is
enough for COPY's purposes. It cannot mix those up with delimiter or
escaping characters, because only single-byte ASCII characters are
supported as delimiters or escape characters.

Discussion: https://www.postgresql.org/message-id/7704d099-9643-2a55-fb0e-becd64400dcb%40iki.fi

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/a5be6e9a1dfe820807f9ccb21dec5144982618e6

Modified Files
--------------
src/backend/commands/copy.c  |  7 ++++++-
src/backend/utils/mb/wchar.c | 32 +++++++++++++++++++++++++-------
2 files changed, 31 insertions(+), 8 deletions(-)


pgsql-committers by date:

Previous
From: Peter Eisentraut
Date:
Subject: pgsql: Allow generalized expression syntax for partition bounds
Next
From: Heikki Linnakangas
Date:
Subject: pgsql: Use single-byte Boyer-Moore-Horspool search even withmultibyte