Re: tsearch2 problem - Mailing list pgsql-general

From Oleg Bartunov
Subject Re: tsearch2 problem
Date
Msg-id Pine.LNX.4.64.0810311308191.15810@sn.sai.msu.ru
Whole thread Raw
In response to tsearch2 problem  ("Jodok Batlogg" <jodok@lovelysystems.com>)
Responses Re: tsearch2 problem  ("Jodok Batlogg" <jodok@lovelysystems.com>)
Re: tsearch2 problem  (Ivan Sergio Borgonovo <mail@webthatworks.it>)
List pgsql-general
Jodok,

you got what's you defined. Please, read documentation.
In short, word doesn't indexed if it is not recognized by any
dictionaried from stack of dictionaries. Put stemming dictionary at the end,
which recognizes everything.

Oleg
On Fri, 31 Oct 2008, Jodok Batlogg wrote:

> we're using tsearch2 with the german dictionary
> http://www.sai.msu.su/~megera/postgres/gist/tsearch/V2/dicts/ispell/ispell-german-compound.tar.gz
> for fulltext search.
>
> the indexing is configured as follows:
>
> CREATE TEXT SEARCH DICTIONARY public.german (
>    TEMPLATE = ispell,
>    DictFile = german,
>    AffFile = german,
>    StopWords = german
> );
>
> CREATE TEXT SEARCH CONFIGURATION public.default ( COPY = pg_catalog.german );
>
> ALTER TEXT SEARCH CONFIGURATION public.default
>    ALTER MAPPING FOR asciiword, asciihword, hword_asciipart,
>                      word, hword, hword_part
>    WITH public.german;
>
> -------------------------
>
> select * from ts_debug('default', 'hundshЪЪtte');
> works as expected: creates the two lexemes: "{hund,hЪЪtte}"
>
> BUT
>
> SELECT to_tsvector('default','lovely und bauarbeiter/in');
> looses a lot of stuff:
> "'bauarbeiter/in':2"
>
> some more debugging shows:
>
> SELECT * from ts_debug('default','lovely und bauarbeiter/in');
>
> "asciiword";"Word, all ASCII";"lovely";"{german}";"german";""
> "blank";"Space symbols";" ";"{}";"";""
> "asciiword";"Word, all ASCII";"und";"{german}";"german";"{}"
> "blank";"Space symbols";" ";"{}";"";""
> "file";"File or path
> name";"bauarbeiter/in";"{simple}";"simple";"{bauarbeiter/in}"
>
> a) unknown words are just beeing dropped
> b) words with slashes are interpreted as file paths and the first path
> is beeing dropped.
>
> any idea how we can fix this?
>
> jodok
>
>

     Regards,
         Oleg
_____________________________________________________________
Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru),
Sternberg Astronomical Institute, Moscow University, Russia
Internet: oleg@sai.msu.su, http://www.sai.msu.su/~megera/
phone: +007(495)939-16-83, +007(495)939-23-83

pgsql-general by date:

Previous
From: "Nick Mellor"
Date:
Subject: Re: Slow query performance
Next
From: "Jodok Batlogg"
Date:
Subject: Re: tsearch2 problem