Re: tsvector limitations - Mailing list pgsql-admin

From Tom Lane
Subject Re: tsvector limitations
Date
Msg-id 14751.1308194046@sss.pgh.pa.us
Whole thread Raw
In response to Re: tsvector limitations  (Tim <elatllat@gmail.com>)
List pgsql-admin
Tim <elatllat@gmail.com> writes:
> My limited testing indicates tsvector size has an approximately linear
> (binomial) correlation with "number of unique words", and "word count".

Yes, it would be linear in the number of unique words (assuming the
average word length stays constant).  It's not linear in word count,
because tsvector only keeps track of distinct word positions for the
first 16K words in the text.  So for large documents only the number of
unique words is really going to matter, and that grows *much* less than
linearly with document size for real-world documents.

            regards, tom lane

pgsql-admin by date:

Previous
From: Tim
Date:
Subject: Re: tsvector limitations
Next
From: bakkiya
Date:
Subject: could not open temporary statistics file "pg_stat_tmp/pgstat.tmp"