Re: [PATCHES] a tsearch2 (8.2.4) dictionary that only filters out stopwords - Mailing list pgsql-hackers

From Bruce Momjian
Subject Re: [PATCHES] a tsearch2 (8.2.4) dictionary that only filters out stopwords
Date
Msg-id 200803072006.m27K6OQ24881@momjian.us
Whole thread Raw
In response to Re: [PATCHES] a tsearch2 (8.2.4) dictionary that only filters out stopwords  (Tom Lane <tgl@sss.pgh.pa.us>)
Responses Re: Re: [PATCHES] a tsearch2 (8.2.4) dictionary that only filters out stopwords  (Tom Lane <tgl@sss.pgh.pa.us>)
List pgsql-hackers
Added to TODO:

* Allow text search dictionary to filter out only stop words

  http://archives.postgresql.org/pgsql-patches/2007-11/msg00081.php


---------------------------------------------------------------------------

Tom Lane wrote:
> Oleg Bartunov <oleg@sai.msu.su> writes:
> > Let's consider one example - removing accents.
> > In the past I always recommend people to use regex functions before
> > to_tsvector conversion to remove accents, but recently I was noticed that
> > such trick doesn't work with headline(). So, the only way is to have
> > special dictionary dict_remove_accent before, which  works as a filter.
>
> > I don't remember why do we left this for future releases, though.
>
> That would require a system-to-dictionary API change (to be able to
> modify the token under inspection), no?  So it's certainly something
> I'd say is too late for 8.3.
>
> One thought that came to mind is that the option name should be just
> "Accept" not "AcceptAll".  To me "All" implies that it would accept
> *everything* ... including stopwords.
>
>             regards, tom lane
>
> ---------------------------(end of broadcast)---------------------------
> TIP 4: Have you searched our list archives?
>
>                http://archives.postgresql.org

--
  Bruce Momjian  <bruce@momjian.us>        http://momjian.us
  EnterpriseDB                             http://postgres.enterprisedb.com

  + If your life is a hard drive, Christ can be your backup. +

pgsql-hackers by date:

Previous
From: Bruce Momjian
Date:
Subject: Re: How to keep a table in memory?
Next
From: Andrew Chernow
Date:
Subject: Re: Commitfest process