Re: default_text_search_config - Mailing list pgsql-hackers

From Tatsuo Ishii
Subject Re: default_text_search_config
Date
Msg-id 20071005.161258.56048359.t-ishii@sraoss.co.jp
Whole thread Raw
In response to Re: default_text_search_config  (ITAGAKI Takahiro <itagaki.takahiro@oss.ntt.co.jp>)
Responses Re: default_text_search_config
Re: default_text_search_config
List pgsql-hackers
> Tatsuo Ishii <ishii@postgresql.org> wrote:
> 
> > For me the idea that a text-search configuration maps to a
> > locale/language seems to be totally wrong. IMO an encoding/charset
> > could include several languages and a text-search configuration should
> > be mapped to an encoding/charset, rather than a language.
> 
> I think mapping by encoding/charset *is* totally wrong and by locale is
> reasonable. How do you treat LATIN1? It can be used in French and German,
> etc. Moreover, UTF-8 can be used in almost all languages.
> 
> The tight mapping of EUC_jp <=> Japanese is a special case in the world.

What? I didn't say that an encoding/charset is mapped to single
language. Actually EUC_JP includes Japanese, English(ascii), Greek,
Cyrillic and so on. So for the full text search being able to process
EUC_JP text properly, it should be able to process multiple languages
at a time.

You know that PostgreSQL allows only one locale for a PostgreSQL
cluster, and the fact that text-search being depending on locale
prevent it from processing multi language text.

The only solution I can think of today is creating new parser which
can process EUC_JP properly (I mean it can process not only Japanese
but also English) and use it on C locale/EUC_JP cluster. I would do
this for 8.4 if I have time.
--
Tatsuo Ishii
SRA OSS, Inc. Japan


pgsql-hackers by date:

Previous
From: ITAGAKI Takahiro
Date:
Subject: Re: default_text_search_config
Next
From: ITAGAKI Takahiro
Date:
Subject: Re: default_text_search_config