Re: UTF16 surrogate pairs in UTF8 encoding - Mailing list pgsql-hackers

From Peter Eisentraut
Subject Re: UTF16 surrogate pairs in UTF8 encoding
Date
Msg-id 1282504364.13679.3.camel@vanquo.pezone.net
Whole thread Raw
In response to UTF16 surrogate pairs in UTF8 encoding  (Tom Lane <tgl@sss.pgh.pa.us>)
Responses Re: UTF16 surrogate pairs in UTF8 encoding
Re: UTF16 surrogate pairs in UTF8 encoding
List pgsql-hackers
On sön, 2010-08-22 at 14:29 -0400, Tom Lane wrote:
> I just noticed that we are now advertising the ability to insert UTF16
> surrogate pairs in strings and identifiers (see section 4.1.2.2 in
> current docs, in particular).  Is this really wise?  I thought that
> surrogate pairs were specifically prohibited in UTF8 strings, because
> of the security hazards implicit in having more than one way to
> represent the same code point.

We combine the surrogate pair components to a single code point and
encode that in UTF-8.  We don't encode the components separately; that
would be wrong.



pgsql-hackers by date:

Previous
From: Stephen Frost
Date:
Subject: Re: security label support, part.2
Next
From: Tom Lane
Date:
Subject: Re: UTF16 surrogate pairs in UTF8 encoding