Re: array size exceeds the maximum allowed (1073741823) when building a json - Mailing list pgsql-performance

From David G. Johnston
Subject Re: array size exceeds the maximum allowed (1073741823) when building a json
Date
Msg-id CAKFQuwYoUjSfoEVnsngS4_eU2LxkHt-LZcUiWjpS92rxEBrv+Q@mail.gmail.com
Whole thread Raw
In response to Re: array size exceeds the maximum allowed (1073741823) when building a json  (Nicolas Paris <niparisco@gmail.com>)
List pgsql-performance
On Tue, Jun 7, 2016 at 8:42 AM, Nicolas Paris <niparisco@gmail.com> wrote:


2016-06-07 14:39 GMT+02:00 David G. Johnston <david.g.johnston@gmail.com>:
On Tue, Jun 7, 2016 at 8:36 AM, Nicolas Paris <niparisco@gmail.com> wrote:
2016-06-07 14:31 GMT+02:00 David G. Johnston <david.g.johnston@gmail.com>:
On Tue, Jun 7, 2016 at 7:44 AM, Nicolas Paris <niparisco@gmail.com> wrote:
Hello,

I run a query transforming huge tables to a json document based on a period.
It works great for a modest period (little dataset).
However, when increasing the period (huge dataset) I get this error:
SQL ERROR[54000]
ERROR: array size exceeds the maximum allowed (1073741823)


​Maximum Field Size: 1 GB​

It means a json cannot exceed 1GB in postgresql, right ?

​Yes​
 
Then I must build it with an external tool ?
 

​​You have to do something different.  Using multiple columns and/or multiple rows might we workable.

​Certainly. Kind of disappointing, because I won't find any json builder as performant as postgresql.​
 


Will this 1GO restriction is supposed to increase in a near future ?​


There has been zero chatter on the public lists about increasing any of the limits on that page I linked to.

David J.
 

pgsql-performance by date:

Previous
From: Nicolas Paris
Date:
Subject: Re: array size exceeds the maximum allowed (1073741823) when building a json
Next
From: Josh Berkus
Date:
Subject: Re: array size exceeds the maximum allowed (1073741823) when building a json