Re: Cascading replication and recovery_target_timeline='latest' - Mailing list pgsql-hackers

From Fujii Masao
Subject Re: Cascading replication and recovery_target_timeline='latest'
Date
Msg-id CAHGQGwEM1-F2XfbcPdhphUadjtYZF3teLWhAHQXLHFYBsudK-A@mail.gmail.com
Whole thread Raw
In response to Cascading replication and recovery_target_timeline='latest'  (Heikki Linnakangas <hlinnaka@iki.fi>)
Responses Re: Cascading replication and recovery_target_timeline='latest'
List pgsql-hackers
On Fri, Aug 31, 2012 at 5:03 PM, Heikki Linnakangas <hlinnaka@iki.fi> wrote:
> When a cascading standby launches a new walsender, it fetches the current
> recovery timeline:
>
>         /*
>          * Use the recovery target timeline ID during recovery
>          */
>         if (am_cascading_walsender)
>                 ThisTimeLineID = GetRecoveryTargetTLI();
>
> Comment in GetRecoveryTargetTLI() does this:
>
>         /* RecoveryTargetTLI doesn't change so we need no lock to copy it */
>         return XLogCtl->RecoveryTargetTLI;
>
>
> That comment is not true. RecoveryTargetTLI can change during recovery, if
> you set recovery_target_timeline='latest'. In 'latest' mode, when the
> (apparent) end of WAL is reached, the archive is scanned for any new
> timeline history files that may have appeared. If a new timeline is found,
> RecoveryTargetTLI is updated, and recovery is continued on the new timeline.

Right. We need lock there for now.

> Aside from the missing locking, I wonder what that does to a cascaded
> standby. If there is an active walsender running while RecoveryTargetTLI is
> changed, I think what will happen is that the walsender will continue to
> stream WAL from the old timeline, but because the startup process is now
> actually replaying from a different timeline, the walsender will send bogus
> WAL to the standby.

Good catch! That's really problem. To address that, we should terminate
all cascading walsenders when the timeline history file is read and
the recovery target timeline is changed?

> When a standby ends recovery, creates a new timeline, and switches to normal
> operation, postmaster terminates all walsenders because of the timeline
> change. But don't we have a race condition there, with similar effect? It
> might take a while for a walsender to die, and in that window, it might send
> bogus WAL to the cascaded standby.

No, I think. The cascading walsender can send only WAL data, up to
min(replay_location, receive_location, restore_location). IOW, it sends
only replayed, received (i.e., streamed), and restored WAL files.
These WAL files belong to old timeline, so ISTM that the cascading
walsender cannot send any new-timeline WAL files.

Regards,

-- 
Fujii Masao



pgsql-hackers by date:

Previous
From: Dave Page
Date:
Subject: Re: _USE_32BIT_TIME_T Patch
Next
From: Dimitri Fontaine
Date:
Subject: Re: patch: shared session variables