pgsql: Update to latest Snowball sources. - Mailing list pgsql-committers

Update to latest Snowball sources.

It's been some time since we did this, partly because the upstream
snowball project hasn't formally tagged a new release since 2021.
The main motivation for doing it now is to absorb a bug fix
(their commit e322673a841d9abd69994ae8cd20e191090b6ef4), which
prevents a null pointer dereference crash if SN_create_env() gets
a malloc failure at just the wrong point.  We'll patch the back
branches with only that change, but we might as well do the full
sync dance on HEAD.

Aside from a bunch of mostly-minor tweaks to existing stemmers, this
update adds a new stemmer for Estonian.  It also removes the existing
stemmer for Romanian using ISO-8859-2 encoding.  Upstream apparently
concluded that ISO-8859-2 doesn't provide an adequate representation
of some Romanian characters, and the UTF-8 implementation should be
used instead.

While at it, update the README's instructions for doing a sync,
which have not been adjusted during the addition of meson tooling.

Thanks to Maksim Korotkov for discovering the null-pointer
bug and submitting the fix to upstream snowball.

Reported-by: Maksim Korotkov <m.korotkov@postgrespro.ru>
Discussion: https://postgr.es/m/1d1a46-67ab1000-21-80c451@83151435

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/b464e51ab32fbf09cf5d9c911a8e26f491ad1f44

Modified Files
--------------
doc/src/sgml/textsearch.sgml                       |    1 +
src/backend/snowball/Makefile                      |    2 +-
src/backend/snowball/README                        |   22 +-
src/backend/snowball/dict_snowball.c               |    4 +-
src/backend/snowball/libstemmer/api.c              |    2 +-
.../snowball/libstemmer/stem_ISO_8859_1_basque.c   |   38 +-
.../snowball/libstemmer/stem_ISO_8859_1_catalan.c  |   29 +-
.../snowball/libstemmer/stem_ISO_8859_1_danish.c   |   14 +-
.../snowball/libstemmer/stem_ISO_8859_1_dutch.c    |   56 +-
.../snowball/libstemmer/stem_ISO_8859_1_english.c  |  154 +-
.../snowball/libstemmer/stem_ISO_8859_1_finnish.c  |   34 +-
.../snowball/libstemmer/stem_ISO_8859_1_french.c   |  256 +--
.../snowball/libstemmer/stem_ISO_8859_1_german.c   |  403 ++--
.../libstemmer/stem_ISO_8859_1_indonesian.c        |   36 +-
.../snowball/libstemmer/stem_ISO_8859_1_irish.c    |   31 +-
.../snowball/libstemmer/stem_ISO_8859_1_italian.c  |  134 +-
.../libstemmer/stem_ISO_8859_1_norwegian.c         |   14 +-
.../snowball/libstemmer/stem_ISO_8859_1_porter.c   |   65 +-
.../libstemmer/stem_ISO_8859_1_portuguese.c        |   48 +-
.../snowball/libstemmer/stem_ISO_8859_1_spanish.c  |   51 +-
.../snowball/libstemmer/stem_ISO_8859_1_swedish.c  |   57 +-
.../libstemmer/stem_ISO_8859_2_hungarian.c         |   31 +-
.../snowball/libstemmer/stem_ISO_8859_2_romanian.c |  965 ---------
.../snowball/libstemmer/stem_KOI8_R_russian.c      |   33 +-
.../snowball/libstemmer/stem_UTF_8_arabic.c        |  124 +-
.../snowball/libstemmer/stem_UTF_8_armenian.c      |   25 +-
.../snowball/libstemmer/stem_UTF_8_basque.c        |   38 +-
.../snowball/libstemmer/stem_UTF_8_catalan.c       |   29 +-
.../snowball/libstemmer/stem_UTF_8_danish.c        |   14 +-
src/backend/snowball/libstemmer/stem_UTF_8_dutch.c |   58 +-
.../snowball/libstemmer/stem_UTF_8_english.c       |  158 +-
.../snowball/libstemmer/stem_UTF_8_estonian.c      | 1416 ++++++++++++++
.../snowball/libstemmer/stem_UTF_8_finnish.c       |   34 +-
.../snowball/libstemmer/stem_UTF_8_french.c        |  274 +--
.../snowball/libstemmer/stem_UTF_8_german.c        |  405 ++--
src/backend/snowball/libstemmer/stem_UTF_8_greek.c |  376 ++--
src/backend/snowball/libstemmer/stem_UTF_8_hindi.c |    2 +-
.../snowball/libstemmer/stem_UTF_8_hungarian.c     |   31 +-
.../snowball/libstemmer/stem_UTF_8_indonesian.c    |   36 +-
src/backend/snowball/libstemmer/stem_UTF_8_irish.c |   31 +-
.../snowball/libstemmer/stem_UTF_8_italian.c       |  134 +-
.../snowball/libstemmer/stem_UTF_8_lithuanian.c    |   27 +-
.../snowball/libstemmer/stem_UTF_8_nepali.c        |    8 +-
.../snowball/libstemmer/stem_UTF_8_norwegian.c     |   14 +-
.../snowball/libstemmer/stem_UTF_8_porter.c        |   65 +-
.../snowball/libstemmer/stem_UTF_8_portuguese.c    |   48 +-
.../snowball/libstemmer/stem_UTF_8_romanian.c      | 1104 ++++++-----
.../snowball/libstemmer/stem_UTF_8_russian.c       |   33 +-
.../snowball/libstemmer/stem_UTF_8_serbian.c       |   35 +-
.../snowball/libstemmer/stem_UTF_8_spanish.c       |   51 +-
.../snowball/libstemmer/stem_UTF_8_swedish.c       |   57 +-
src/backend/snowball/libstemmer/stem_UTF_8_tamil.c | 2064 ++++++++------------
.../snowball/libstemmer/stem_UTF_8_turkish.c       |  243 +--
.../snowball/libstemmer/stem_UTF_8_yiddish.c       |   91 +-
src/backend/snowball/libstemmer/utilities.c        |    6 +-
src/backend/snowball/meson.build                   |    2 +-
src/backend/snowball/snowball_create.pl            |    1 +
src/bin/initdb/initdb.c                            |    2 +
src/include/snowball/libstemmer/header.h           |    2 +-
.../snowball/libstemmer/stem_ISO_8859_2_romanian.h |   15 -
.../snowball/libstemmer/stem_UTF_8_estonian.h      |   15 +
61 files changed, 4970 insertions(+), 4578 deletions(-)