Re: Pre-proposal: unicode normalized text - Mailing list pgsql-hackers

From Robert Haas
Subject Re: Pre-proposal: unicode normalized text
Date
Msg-id CA+TgmoYOVdnNL+2B+hizoz0Pgx1k7r_VOfeLp2goJz92NOAhEw@mail.gmail.com
Whole thread Raw
In response to Re: Pre-proposal: unicode normalized text  ("Daniel Verite" <daniel@manitou-mail.org>)
Responses Re: Pre-proposal: unicode normalized text
List pgsql-hackers
On Tue, Oct 17, 2023 at 11:07 AM Daniel Verite <daniel@manitou-mail.org> wrote:
> There's a problem in the fact that the set of assigned code points is
> expanding with every Unicode release, which happens about every year.
>
> If we had this option in Postgres 11 released in 2018 it would use
> Unicode 11, and in 2023 this feature would reject thousands of code
> points that have been assigned since then.

Are code points assigned from a gapless sequence? That is, is the
implementation of codepoint_is_assigned(char) just 'codepoint <
SOME_VALUE' and SOME_VALUE increases over time?

If so, we could consider having a function that lets you specify the
bound as an input parameter. But whether anyone would use it, or know
how to set that input parameter, is questionable. The real issue here
is whether you can figure out which of the code points that you could
put into the database already have collation definitions.

--
Robert Haas
EDB: http://www.enterprisedb.com



pgsql-hackers by date:

Previous
From: "Daniel Verite"
Date:
Subject: Re: Pre-proposal: unicode normalized text
Next
From: Peter Geoghegan
Date:
Subject: Re: run pgindent on a regular basis / scripted manner