Re: Long running query causing XID limit breach - Mailing list pgsql-general

From Laurenz Albe
Subject Re: Long running query causing XID limit breach
Date
Msg-id 56ad97911d83f721dd872e8ee68cd77d50d3eef6.camel@cybertec.at
Whole thread Raw
In response to Re: Long running query causing XID limit breach  (yudhi s <learnerdatabase99@gmail.com>)
Responses Re: Long running query causing XID limit breach
List pgsql-general
On Wed, 2024-05-29 at 01:34 +0530, yudhi s wrote:
> > The only way you can have no delay in replication AND no canceled queries is
> > if you use two different standby servers with different settings for
> > "max_standby_streaming_delay".  One of the server is for HA, the other for
> > your long-running queries.
>
> When you suggest having different max_standby_streaming_delay for first replica
> (say 10 sec for High availability) and second replica(say -1 for long running queries).
> Do you also suggest  keeping "hot_feedback_standby" as "OFF" for all the three
> instances i.e. master and both the replicas?

The parameter is ignored on the master.
It needs to be off on the standby that is running long queries.
For the other standby it probably doesn't matter if you are not running any
queries on it.  I would leave "hot_standby_feedback = off" there as well.

Actually, I would set "hot_standby = off" on the standby that is only used
for HA.

> Also OP has added a few other parameters as below, do you think these should be needed? 
>  I think the master and first replica should have the same set up because in case
> of any disaster to master the first replica should be able to take the place of master.
>  
> Master/Primary                First Replica/Standby for High Availability    Second Replica for Reporting
> hot_standby_feedback=ON            hot_standby_feedback=ON                hot_standby_feedback=OFF
> max_standby_streaming_delay=10 sec        max_standby_streaming_delay=10 sec        max_standby_streaming_delay=-1
(Infinite)
> statement_timeout = "2hrs"            statement_timeout="2hrs"            No statement_timeout i.e. infinite
> idle_in_transaction_session_timeout=10minutes    idle_in_transaction_session_timeout=10minutes    No
idle_in_transaction_session_timeouti.e. infinite 
> autovacuum_freeze_max_age=100M        autovacuum_freeze_max_age=100M            autovacuum_freeze_max_age=100M
> Log_autovacuum_min_duration=0            Log_autovacuum_min_duration=0            Log_autovacuum_min_duration=0

- I would leave "hot_standby_feedback" off everywhere.
- "max_standby_streaming_delay" should be -1 on the reporting standby and very
  low or 0 on the HA standby. It doesn't matter on the primary.
- "statement_timeout" should be way lower on the first two nodes.
- "idle_in_transaction_session_timeout" is good.
- I would leave "autovacuum_freeze_max_age" at the default setting but 100 million
  is ok too.

Yours,
Laurenz Albe



pgsql-general by date:

Previous
From: vijay patil
Date:
Subject: Re: Pgpool with high availability
Next
From: David Rowley
Date:
Subject: Re: Use of inefficient index in the presence of dead tuples