pgsql: Migrate logical slots to the new node during an upgrade. - Mailing list pgsql-committers

From Amit Kapila
Subject pgsql: Migrate logical slots to the new node during an upgrade.
Date
Msg-id E1qvptE-002LgU-FD@gemulon.postgresql.org
Whole thread Raw
Responses Re: pgsql: Migrate logical slots to the new node during an upgrade.
List pgsql-committers
Migrate logical slots to the new node during an upgrade.

While reading information from the old cluster, a list of logical
slots is fetched. At the later part of upgrading, pg_upgrade revisits the
list and restores slots by executing pg_create_logical_replication_slot()
on the new cluster. Migration of logical replication slots is only
supported when the old cluster is version 17.0 or later.

If the old node has invalid slots or slots with unconsumed WAL records,
the pg_upgrade fails. These checks are needed to prevent data loss.

The significant advantage of this commit is that it makes it easy to
continue logical replication even after upgrading the publisher node.
Previously, pg_upgrade allowed copying publications to a new node. With
this patch, adjusting the connection string to the new publisher will
cause the apply worker on the subscriber to connect to the new publisher
automatically. This enables seamless continuation of logical replication,
even after an upgrade.

Author: Hayato Kuroda, Hou Zhijie
Reviewed-by: Peter Smith, Bharath Rupireddy, Dilip Kumar, Vignesh C, Shlok Kyal
Discussion: http://postgr.es/m/TYAPR01MB58664C81887B3AF2EB6B16E3F5939@TYAPR01MB5866.jpnprd01.prod.outlook.com
Discussion: http://postgr.es/m/CAA4eK1+t7xYcfa0rEQw839=b2MzsfvYDPz3xbD+ZqOdP3zpKYg@mail.gmail.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/29d0a77fa6606f9c01ba17311fc452dabd3f793d

Modified Files
--------------
doc/src/sgml/ref/pgupgrade.sgml                    |  78 ++++++++-
src/backend/replication/logical/decode.c           |  48 +++++-
src/backend/replication/logical/logical.c          |  75 ++++++++
src/backend/replication/slot.c                     |  14 ++
src/backend/utils/adt/pg_upgrade_support.c         |  44 +++++
src/bin/pg_upgrade/Makefile                        |   3 +
src/bin/pg_upgrade/check.c                         | 168 +++++++++++++++++-
src/bin/pg_upgrade/function.c                      |  30 +++-
src/bin/pg_upgrade/info.c                          | 166 +++++++++++++++++-
src/bin/pg_upgrade/meson.build                     |   1 +
src/bin/pg_upgrade/pg_upgrade.c                    |  74 +++++++-
src/bin/pg_upgrade/pg_upgrade.h                    |  22 ++-
src/bin/pg_upgrade/server.c                        |  25 ++-
.../t/003_upgrade_logical_replication_slots.pl     | 192 +++++++++++++++++++++
src/include/catalog/catversion.h                   |   2 +-
src/include/catalog/pg_proc.dat                    |   5 +
src/include/replication/logical.h                  |   5 +
src/tools/pgindent/typedefs.list                   |   2 +
18 files changed, 927 insertions(+), 27 deletions(-)


pgsql-committers by date:

Previous
From: Tom Lane
Date:
Subject: pgsql: Doc: remove misleading info about ecpg's CONNECT/DISCONNECT DEFA
Next
From: Amit Langote
Date:
Subject: pgsql: Prevent duplicate RTEPermissionInfo for plain-inheritance parent