Re: BUG #15320: = any (array(SQL)) ERROR: invalid memory allocrequest size 1073741824 - Mailing list pgsql-bugs

From Andres Freund
Subject Re: BUG #15320: = any (array(SQL)) ERROR: invalid memory allocrequest size 1073741824
Date
Msg-id 20180810022634.ggxwlwm6avraufjv@alap3.anarazel.de
Whole thread Raw
In response to BUG #15320: = any (array(SQL)) ERROR: invalid memory alloc requestsize 1073741824  (PG Bug reporting form <noreply@postgresql.org>)
List pgsql-bugs
Hi,

On 2018-08-10 02:00:56 +0000, PG Bug reporting form wrote:
> postgres=# explain analyze select count(*) from tbl where uid = any
> (array(select uid from tbl limit 100000000))    ;
> ERROR:  XX000: invalid memory alloc request size 1073741824
> LOCATION:  repalloc, mcxt.c:1050
> Time: 24133.852 ms (00:24.134)
> ```
> 
> is it a bug?

No, not in my opinion. You're building a very large array. Arrays are
stored in memory. Allocation sizes in postgres are limited in many
places.

You could argue for removing the limit in this case, but that'd not make
it a bug. And I doubt it's worth changing this. Your array is going to
be huge either way, and we limit arrays (and other datums) to 1GB. We
could fix the growth of the array here to fail a bit later, but that's
it.

Greetings,

Andres Freund


pgsql-bugs by date:

Previous
From: PG Bug reporting form
Date:
Subject: BUG #15320: = any (array(SQL)) ERROR: invalid memory alloc requestsize 1073741824
Next
From: DEGLAVE Remi
Date:
Subject: [PG_UPGRADE] 9.6 to 10.5