Re: multi terabyte fulltext searching - Mailing list pgsql-general

From Teodor Sigaev
Subject Re: multi terabyte fulltext searching
Date
Msg-id 46015A40.7090606@sigaev.ru
Whole thread Raw
In response to Re: multi terabyte fulltext searching  (Benjamin Arai <benjamin@araisoft.com>)
List pgsql-general
> I am currently using GIST indexes because I receive about 10GB of new
> data a week (then again I am not deleting any information).  The do not
> expect to be able to stop receiving text for about 5 years, so the data
> is not going to become static any time soon.  The reason I am concerned
> with performance is that I am providing a search system for several
> newspapers since essentially the beginning of time.  Many bibliographer
> etc would like to use this utility but if each search takes too long I
> am not going to be able to support many concurrent users.

Use GiST and GIN indexes together: any data older than one month (which doesn't
change) with GIN index and new data with GiST. And one time per month moves data
from GiST to GIN.

--
Teodor Sigaev                                   E-mail: teodor@sigaev.ru
                                                    WWW: http://www.sigaev.ru/

pgsql-general by date:

Previous
From: Benjamin Arai
Date:
Subject: Re: multi terabyte fulltext searching
Next
From: Benjamin Arai
Date:
Subject: Re: multi terabyte fulltext searching