full text search: the concept of a "word" - Mailing list pgsql-general

From Tomi NA
Subject full text search: the concept of a "word"
Date
Msg-id d487eb8e0604201520w3532cdd7saa2596046b5cbe51@mail.gmail.com
Whole thread Raw
Responses Re: full text search: the concept of a "word"  (Teodor Sigaev <teodor@sigaev.ru>)
List pgsql-general
I'm considering using tsearch2 in the project I'm working on right
now...however, I'm not sure if tsearch2 can handle my very specific
requirements - I therefore hope someone can tell me if the following
is possible and how I should go about it...

My textfields are trigger-generated using information from a number of
tables: these fields can be, say, a couple of thousand characters
wide.
Up to here, there's no problem.
What I'd like to do is define - possibly using regexps - what
constitutes a word. For instance, my word separator is a semicolon,
not a space; a dash is not a separator, and neither are language
specific characters (which might be interpreted that way by a language
agnostic tool)...
BTW, I use UTF-8 as my database encoding if it's of any importance.

What it comes down to is this: is it possible to somehow define what
constitutes a word?

TIA,
Tomislav

pgsql-general by date:

Previous
From: Tom Lane
Date:
Subject: Re: sudo-like behavior
Next
From: "Tomi NA"
Date:
Subject: setting the environment locale - linux, windows