Thread: Lob Streaming

Lob Streaming

From
Ramesh Reddy
Date:
Hi,

Does psql-odbc driver support lob streaming? I could successfully get
'bytea' content, but for large size > GB lobs I  am running into memory
issues. Can you body suggest any alternatives.

Thanks

Ramesh..


Re: Lob Streaming

From
Richard Broersma
Date:


On Mon, Feb 7, 2011 at 7:00 AM, Ramesh Reddy <rareddy@redhat.com> wrote:
Hi,

Does psql-odbc driver support lob streaming? I could successfully get
'bytea' content, but for large size > GB lobs I  am running into memory
issues. Can you body suggest any alternatives.
 
Try using the PostgreSQL contrib module "lo."

http://www.postgresql.org/docs/9.0/interactive/lo.html

also see:
http://www.postgresql.org/docs/9.0/interactive/vacuumlo.html

--
Regards,
Richard Broersma Jr.

Re: Lob Streaming

From
Ramesh Reddy
Date:
Thank you for the info.

I am afraid, the code I see in the ODBC driver is not doing streaming.
It makes one lo_read call based on the buffer size configured in your
client and truncates the rest of the content.

What I would like to have seen is, driver making a small length lo_read
calls to fill up the buffer size provided by the client, then truncate
if the size is larger, not request one huge chuck of read from the
server.

Ramesh..

On Mon, 2011-02-07 at 08:18 -0800, Richard Broersma wrote:
>
>
> On Mon, Feb 7, 2011 at 7:00 AM, Ramesh Reddy <rareddy@redhat.com>
> wrote:
>         Hi,
>
>         Does psql-odbc driver support lob streaming? I could
>         successfully get
>         'bytea' content, but for large size > GB lobs I  am running
>         into memory
>         issues. Can you body suggest any alternatives.
>
> Try using the PostgreSQL contrib module "lo."
>
> http://www.postgresql.org/docs/9.0/interactive/lo.html
>
> also see:
> http://www.postgresql.org/docs/9.0/interactive/vacuumlo.html
>
> --
> Regards,
> Richard Broersma Jr.