Re: JSON out of memory error on PostgreSQL 9.6.x - Mailing list pgsql-general

From rob stone
Subject Re: JSON out of memory error on PostgreSQL 9.6.x
Date
Msg-id 1512345677.5030.1.camel@gmail.com
Whole thread Raw
In response to JSON out of memory error on PostgreSQL 9.6.x  (Yuri Budilov <yuri.budilov@hotmail.com>)
Responses Re: JSON out of memory error on PostgreSQL 9.6.x
List pgsql-general

On Sun, 2017-12-03 at 23:18 +0000, Yuri Budilov wrote:
> Posted on Stack Overflow, sadly no replies, so trying here....
> 
>  CREATE TABLE X AS
> SELECT json_array_elements(json_rmq -> 'orders'::text) AS order
> FROM table_name
> WHERE blah;
> I get out of memory error.
> 
> Is there anything I can do to unpack the above?
> 
> The JSON column is about ~5 MB and it has about ~150,000 array
> row elements in 'orders' above.
> 
> I tried work_mem values up to ~250MB and it did not help, the query
> takes about same time to fail.
> 
> I guess this parameter does not help JSON processing.
> 
> If there another parameter I can try? Something else?
> 
> I don't have control of the size of the JSON payload, it arrives, we
> store it in a JSON column and then we need to crack it open.
> 
> Many thanks!
> 



Hello,

It would help if you advised:-
(a) version of PostgreSql being used.
(b) is column json_rmq defined as json or jsonb?
(c) OS.

Cheers,
Rob



pgsql-general by date:

Previous
From: Tom Lane
Date:
Subject: Re: JSON out of memory error on PostgreSQL 9.6.x
Next
From: "Peter J. Holzer"
Date:
Subject: Re: large numbers of inserts out of memory strategy