Re: Transaction size and Wal2Json - Mailing list pgsql-performance

From Peter Eisentraut
Subject Re: Transaction size and Wal2Json
Date
Msg-id 7b3ad474-bdf2-11fb-c53d-add6882333ed@2ndquadrant.com
Whole thread Raw
In response to Transaction size and Wal2Json  (Mai Peng <maily.peng@webedia-group.com>)
List pgsql-performance
On 07/02/2019 11:38, Mai Peng wrote:
> We use the plugin Wal2Json in order to catch every modification on database. We’ve got an issue : WAL were growing
veryfast, the state of pg_stat_replication still on ‘catchup’ , an error:pg_recvlogical: unexpected termination of
replicationstream: ERROR: out of memory DETAIL: Cannot enlarge string buffer. It seems Wal2Json can not handle very big
transactions( more than 1 Gb).
 
> How could we measure the size of a transaction ?
> Could we increase this limitation ? 

You should send a bug report to wal2json.

It's plausible that some naive coding would run into the limitation that
you describe, but a bit of effort can probably solve it.

-- 
Peter Eisentraut              http://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services


pgsql-performance by date:

Previous
From: Mai Peng
Date:
Subject: Transaction size and Wal2Json
Next
From: Mariel Cherkassky
Date:
Subject: Re: autovacuum big table taking hours and sometimes seconds