Re: libpq - lack of support to set the fetch size - Mailing list pgsql-general

From Adrian Klaver
Subject Re: libpq - lack of support to set the fetch size
Date
Msg-id 531D06C0.6070506@aklaver.com
Whole thread Raw
In response to libpq - lack of support to set the fetch size  (matshyeq <matshyeq@gmail.com>)
List pgsql-general
On 03/09/2014 06:43 AM, matshyeq wrote:
> Hello,
>
> I've found an issue when tried to implement fetching rows from big table
> (2mln rows) in my app.
> Basically I don't find an elegant and easy way (other than always use
> cursors) to limit the number of rows returned.
> This causes my application to break due to the excessive memory consumption.

LIMIT does not work?

>
> I'm using Perl and DBD::Pg library but contacted maintainer who actually
> pointed out this is an issue that goes much deeper (libpq):
>
> "Unfortunately, this is a limitation in the underlying driver (libpq)
> rather than DBD::Pg itself. There have been talks over the years of
> supporting this, but nothing concrete yet. Your best bet would be to ask
> about this on the Postgres lists"
>
> Would you consider putting this on the roadmap, so one day it gets improved?
>
> Re, the details of the issue, I believe this has been well described at:
> http://stackoverflow.com/questions/21960121/perl-dbdpg-script-fails-when-selecting-data-from-big-table
>
> Kind Regards
> ~Msciwoj


--
Adrian Klaver
adrian.klaver@aklaver.com


pgsql-general by date:

Previous
From: matshyeq
Date:
Subject: libpq - lack of support to set the fetch size
Next
From: "Daniel Verite"
Date:
Subject: Re: libpq - lack of support to set the fetch size