string_to_array eats too much memory? - Mailing list pgsql-hackers

From Tatsuo Ishii
Subject string_to_array eats too much memory?
Date
Msg-id 20061108.143416.63047068.t-ishii@sraoss.co.jp
Whole thread Raw
Responses Re: string_to_array eats too much memory?  (Teodor Sigaev <teodor@sigaev.ru>)
Re: string_to_array eats too much memory?  (Tom Lane <tgl@sss.pgh.pa.us>)
List pgsql-hackers
Hi,

I'm playing with GIN to make a full text search system. GIN comes with
built-in TEXT[] support and I use string_to_array() to make a
TEXT[]. Problem is, if there's large number of array elemets,
string_to_array() consumes too much memory. For example, to make ~70k
array elements, string_to_array seems to eat several Gig bytes of
memory. ~70k array elements means there are same number of words in a
document which is not too big in a large text IMO.

Comments?
--
Tatsuo Ishii
SRA OSS, Inc. Japan


pgsql-hackers by date:

Previous
From: "Luke Lonergan"
Date:
Subject: Re: Block B-tree etc. (was Re: Introducing an advanced Frequent
Next
From: Teodor Sigaev
Date:
Subject: Re: Index ignored with "is not distinct from", 8.2 beta2