Re: gsoc, text search selectivity and dllist enhancments - Mailing list pgsql-hackers

From Alvaro Herrera
Subject Re: gsoc, text search selectivity and dllist enhancments
Date
Msg-id 20080710202731.GH3757@alvh.no-ip.org
Whole thread Raw
In response to Re: gsoc, text search selectivity and dllist enhancments  (Jan Urbański <j.urbanski@students.mimuw.edu.pl>)
Responses Re: gsoc, text search selectivity and dllist enhancments
Re: gsoc, text search selectivity and dllist enhancments
List pgsql-hackers
Jan Urbański wrote:

> Oh, one important thing. You need to choose a bucket width for the LC  
> algorithm, that is decide after how many elements will you prune your  
> data structure. I chose to prune after every twenty tsvectors.

Do you prune after X tsvectors regardless of the numbers of lexemes in
them?  I don't think that preserves the algorithm properties; if there's
a bunch of very short tsvectors and then long tsvectors, the pruning
would take place too early for the initial lexemes.  I think you should
count lexemes, not tsvectors.


-- 
Alvaro Herrera                                http://www.CommandPrompt.com/
The PostgreSQL Company - Command Prompt, Inc.


pgsql-hackers by date:

Previous
From: Tom Lane
Date:
Subject: Re: Generating code coverage reports
Next
From: Jan Urbański
Date:
Subject: Re: gsoc, text search selectivity and dllist enhancments