Re: Include Lists for Text Search - Mailing list pgsql-hackers

From Oleg Bartunov
Subject Re: Include Lists for Text Search
Date
Msg-id Pine.LNX.4.64.0709101631050.2767@sn.sai.msu.ru
Whole thread Raw
In response to Re: Include Lists for Text Search  (Simon Riggs <simon@2ndquadrant.com>)
List pgsql-hackers
On Mon, 10 Sep 2007, Simon Riggs wrote:

> On Mon, 2007-09-10 at 12:58 +0100, Heikki Linnakangas wrote:
>> Simon Riggs wrote:
>>> It seems possible to write your own functions to support various
>>> possibilities with text search.
>>>
>>> One of the more common thoughts is to have a list of words that you
>>> would like to include, i.e. the opposite of a stop word list.
>>>
>>> There are clear indications that indexing too many words is a problem
>>> for both GIN and GIST. If people already know what they'll be looking
>>> for and what they will never be looking for, it seems easier to supply
>>> that list up front, rather than hide it behind lots of hand-crafted
>>> code.
>>
>> I don't understand what you're proposing. We already have dict_synonym
>> that you can use to accept a simple list of words.
>
> How does that allow me to limit the number of words to a known list?

text search doesn't index unknown words, so if your mapping contains
only one dictionary, this dictionary will control what words to index.
While dict_synonym is good for not big list I'd write separate dictionary
with fast lookup.
    Regards,        Oleg
_____________________________________________________________
Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru),
Sternberg Astronomical Institute, Moscow University, Russia
Internet: oleg@sai.msu.su, http://www.sai.msu.su/~megera/
phone: +007(495)939-16-83, +007(495)939-23-83


pgsql-hackers by date:

Previous
From: Simon Riggs
Date:
Subject: Re: Include Lists for Text Search
Next
From: Oleg Bartunov
Date:
Subject: Re: Include Lists for Text Search