Re: [SQL] EXTERNAL storage and substring on long strings - Mailing list pgsql-performance

From Tom Lane
Subject Re: [SQL] EXTERNAL storage and substring on long strings
Date
Msg-id 3574.1060012423@sss.pgh.pa.us
Whole thread Raw
In response to Re: EXTERNAL storage and substring on long strings  (Scott Cain <cain@cshl.org>)
Responses Re: [SQL] EXTERNAL storage and substring on long strings  (Scott Cain <cain@cshl.org>)
Re: [SQL] EXTERNAL storage and substring on long strings  (Jan Wieck <JanWieck@Yahoo.com>)
List pgsql-performance
Scott Cain <cain@cshl.org> writes:
> At least this appears to work and is much faster, completing substring
> operations like above in about 0.27 secs (that's about two orders of
> magnitude improvement!)

I find it really, really hard to believe that a crude reimplementation
in plpgsql of the TOAST concept could beat the built-in implementation
at all, let alone beat it by two orders of magnitude.

Either there's something unrealistic about your testing of the
dna_string function, or your original tests are not causing TOAST to be
invoked in the expected way, or there's a bug we need to fix.  I'd
really like to see some profiling of the poor-performing
external-storage case, so we can figure out what's going on.

            regards, tom lane

pgsql-performance by date:

Previous
From: "Fernando Papa"
Date:
Subject: Re: I can't wait too much: Total runtime 432478.44 msec
Next
From: Richard Huxton
Date:
Subject: Re: [SQL] EXTERNAL storage and substring on long strings