Bloom Filter indexes? - Mailing list pgsql-hackers

From Gregory Maxwell
Subject Bloom Filter indexes?
Date
Msg-id e692861c05052818291df35f9b@mail.gmail.com
Whole thread Raw
In response to Bloom Filter indexes?  (Gregory Maxwell <gmaxwell@gmail.com>)
List pgsql-hackers
Has any thought been given to adding bloom filter indexes to PostgreSQL?

A bloom index would be created on a column, and could then be used to
accelerate exact matches where it is common that the user may query
for a value that doesn't exist. For example, with the query select
userid from user_table where name="notauser", the failure could be
returned instantly, in most cases.

A bloom filter index could be used to accelerate joins, esp full outer joins.

Insertions into a bloom filter are very cheap. Updates could be done
as an insert. Deletes are expensive (either you make a refcounted
filter or you regenerate the filter). However, since bloom filters
have false positives, it would be acceptable to regenerate the filter
during a vacuum if there have been entries deleted or updated. The
filter could be resized at vacuum time based on statistics gathered
during execution.

It would also be useful to have an array bloom index: store a bloom
filter per record for an arrayed field, as well as the bloom filter
for all records. This would allow membership tests for a field
containing large arrays to happen very quickly. Perhaps useful for GIS
and full text indexing applications.


pgsql-hackers by date:

Previous
From: Gregory Maxwell
Date:
Subject: Bloom Filter indexes?
Next
From: Tom Lane
Date:
Subject: Inefficiency in recent pgtz patch