Re: Where **not** to use PostgreSQL? - Mailing list pgsql-general

From Michel Pelletier
Subject Re: Where **not** to use PostgreSQL?
Date
Msg-id CACxu=vKmkKnMq3t-=1r6M5G9=xpAxhkAd-+7UxHSj+QbaarLTg@mail.gmail.com
Whole thread Raw
In response to Re: Where **not** to use PostgreSQL?  (Nicolas Grilly <nicolas@gardentechno.com>)
List pgsql-general
On Thu, Feb 28, 2019 at 4:50 AM Nicolas Grilly <nicolas@gardentechno.com> wrote:
On Thu, Feb 28, 2019 at 1:24 PM Chris Travers <chris.travers@gmail.com> wrote:
1.  a) TB-scale full text search systems.
     b) PostgreSQL's full text search is quite capable but not so powerful that it can completely replace Lucene-based systems.  So you have to consider complexity vs functionality if you are tying with other data that is already in PostgreSQL.  Note further that my experience with at least ElasticSearch is that it is easier to scale something built on multiple PostgreSQL instances into the PB range than it is to scale ElasticSearch into the PB range.
     c) Solr or ElasticSearch

One question about your use of PostgreSQL for a TB-scale full-text search system: Did you order search results using ts_rank or ts_rank_cd? I'm asking because in my experience, PostgreSQL full-text search is extremely efficient, until you need ranking. It's because the indexes don't contain the necessary information for ranking, and because of this the heap has to be consulted, which implies a lot of random IO.


Check out the RUM index extension, it adds ranking information to indexes to speed up exactly the problem you pointed out:


 

pgsql-general by date:

Previous
From: Adrian Klaver
Date:
Subject: Re: Pgbackrest Comparability issue
Next
From: Stephen Frost
Date:
Subject: Re: automated refresh of dev from prod