Re: Counting the occurences of a substring within a very large text - Mailing list pgsql-general

From Marc Mamin
Subject Re: Counting the occurences of a substring within a very large text
Date
Msg-id B6F6FD62F2624C4C9916AC0175D56D8828BEA89E@jenmbs01.ad.intershop.net
Whole thread Raw
In response to Re: Counting the occurences of a substring within a very large text  (Geoff Winkless <pgsqladmin@geoff.dj>)
List pgsql-general


>>On 24 June 2015 at 14:51, Marc Mamin <M.Mamin@intershop.de> wrote:
>>note that the 345MB text only contains 635 lines. This might be the issue...

>There's similar issue discussed here:

>http://www.postgresql.org/message-id/6046.1353874252@sss.pgh.pa.us

>Tom did seem to accept that the attempted alloc is larger than it needs to be, but even if it were fixed you would
stillrun into problems further down the line managing values of that size.
 


Thanks,

does it means that the issue would also occur in a (not yet existing) function that would just count the substring,
withouthaving to manipulate the text itself ?
 
or in other words, are there string functions that can handle such large text in stream, or is it always necessary to
allocenough memory for the whole text first ?
 

Marc 

pgsql-general by date:

Previous
From:
Date:
Subject: Re: mirroring a server and/or hot standby
Next
From: "Gauthier, Dave"
Date:
Subject: Re: DB access speeds, App(linux)<->PG(linux) vs App(linux) <->MSSql(Windows)