Re: Questions on logical replication - Mailing list pgsql-general

From Koen De Groote
Subject Re: Questions on logical replication
Date
Msg-id CAGbX52GF=n7-vi5VnfnMXKkf=CfbX_nAgmy3=eezLU6XWXqjfw@mail.gmail.com
Whole thread Raw
In response to Re: Questions on logical replication  (Adrian Klaver <adrian.klaver@aklaver.com>)
Responses Re: Questions on logical replication
Re: Questions on logical replication
List pgsql-general
What I'm trying to do is upgrade a PG11 database to PG16, using logical replication.

The PG11 has an active and a standby, there are a handful of databases. On particular one has a few tables just over 100GB, then a few 100 tables near 1GB.

What I'd do is start a publication with no tables and add them 1 at a time, refreshing subscription each time.

This might take a long time, so my main questions relate to potential network issues or various situations where the instance receiving the logical replication, suddenly stop being able to receive.

Resyncing, and the effects of WAL buildup, are my main concern.

Accidentally sent a mail to only your email, sorry for that.

Regards,
Koen De Groote

On Fri, Jun 7, 2024 at 5:15 PM Adrian Klaver <adrian.klaver@aklaver.com> wrote:
On 6/6/24 15:19, Koen De Groote wrote:
> I'll give them a read, though it might take a few weekends
>
> Meanwhile, this seems to be what I'm looking for:
>
>  From
> https://www.postgresql.org/docs/current/warm-standby.html#STREAMING-REPLICATION-SLOTS <https://www.postgresql.org/docs/current/warm-standby.html#STREAMING-REPLICATION-SLOTS>
>
> " Replication slots provide an automated way to ensure that the primary
> does not remove WAL segments until they have been received by all
> standbys, and that the primary does not remove rows which could cause a
> recovery conflict
> <https://www.postgresql.org/docs/current/hot-standby.html#HOT-STANDBY-CONFLICT> even when the standby is disconnected."
>
> I'm reading that as: "if there is a replication slot, if the standby is
> disconnected, WAL is kept"
>
> And if we know WAL is kept in the "pg_wal" directory, that sounds like
> it could slowly but surely fill up disk space.
>
>
> But again, I'll give them a read. I've read all of logical replication
> already, and I feel like I didn't get my answer there.

It would be a good idea to provide an a fairly specific outline of what
you are trying to achieve, then it would be easier for folks to offer
suggestions on what to do or not to do.

>
> Thanks for the help
>
>
> Regards,
> Koen De Groote

--
Adrian Klaver
adrian.klaver@aklaver.com

pgsql-general by date:

Previous
From: yudhi s
Date:
Subject: Re: Question on pg_cron
Next
From: Adrian Klaver
Date:
Subject: Re: Questions on logical replication