Postgres Pro
Downloads
Home   >   mailing lists

Re: string_to_array eats too much memory? - Mailing list pgsql-hackers

From Teodor Sigaev
Subject Re: string_to_array eats too much memory?
Date
Msg-id 4551B83A.6090007@sigaev.ru
Whole thread Raw
In response to Re: string_to_array eats too much memory?  (Tatsuo Ishii <ishii@sraoss.co.jp>)
Responses Re: string_to_array eats too much memory?  (Tatsuo Ishii <ishii@sraoss.co.jp>)
List pgsql-hackers
Tree view 
> Porblem with Japanese is, it's an agglutinative language and we need
> to separate each word from a sentence. So, I need to modify tsearch2
> anyway (I know someone from Japan is working on this).
https://www.oss.ecl.ntt.co.jp/tsearch2j/index.html
That's it?

> 
> BTW, can tsearch2 handle ~70k words in a document?

I don't see any problem. tsvector size should not be greater than 1Mb however.

-- 
Teodor Sigaev                                   E-mail: teodor@sigaev.ru
  WWW: http://www.sigaev.ru/

pgsql-hackers by date:

Previous
From: Tatsuo Ishii
Date:
Subject: Re: string_to_array eats too much memory?
Next
From: Tom Lane
Date:
Subject: Re: string_to_array eats too much memory?