Re: [EXTERNAL] Re: pg_basebackup behavior on non-existent slot - Mailing list pgsql-bugs
| From | Dimitri Fontaine |
|---|---|
| Subject | Re: [EXTERNAL] Re: pg_basebackup behavior on non-existent slot |
| Date | |
| Msg-id | VI1PR83MB0189555A09427A714E00FF6499A89@VI1PR83MB0189.EURPRD83.prod.outlook.com Whole thread Raw |
| In response to | Re: pg_basebackup behavior on non-existent slot (Magnus Hagander <magnus@hagander.net>) |
| Responses |
Re: [EXTERNAL] pg_basebackup behavior on non-existent slot
(Daniel Gustafsson <daniel@yesql.se>)
|
| List | pgsql-bugs |
Thanks Magnus for linking the two approaches together, I missed Daniel’s effort entirely. I think it’s safe to focus on Daniel’s entry in the commit fest, and use this pgsql-bugs email as a reminder that it should very probably be backported as a bug-fix to all the maintained branches.
Regards,
--
Dimitri Fontaine
PostgreSQL Major Contributor, Citus Data, Microsoft
Author of “The Art of PostgreSQL”
On 28/09/2021 12:25, "Magnus Hagander" <magnus@hagander.net> wrote:
On Tue, Sep 28, 2021 at 12:03 PM Dimitri Fontaine
<Dimitri.Fontaine@microsoft.com> wrote:
>
> Hi,
>
>
>
> When developing pg_auto_failover we found a bug where if the target replication slot given to pg_basebackup does not exist, then a full copy of the source PGDATA is completed before erroring out. You could easily end-up copying 100GB of data over the network just to see pg_basebackup remove them all at the end, and then when using the –progress option, you have to scroll up to the very start of the output to see the error message.
>
>
>
> Please find attached a patch that shows a way to fix the issue. The patch is missing windows compatibility, I don’t know how to cast the WNOHANG spell on this platform. Please use the patch as you see fit, either inspiration, or maybe something you would like to commit to fix the bug.
>
>
>
> Here what it looks like without the patch:
>
>
>
> $ ./src/bin/pg_basebackup/pg_basebackup -p 5501 -D /tmp/bb -X stream -S SlotDoesNotExists -P
>
> pg_basebackup: error: could not send replication command "START_REPLICATION": ERROR: replication slot "SlotDoesNotExists" does not exist
>
> 32971/32971 kB (100%), 1/1 tablespace
>
> pg_basebackup: error: child process exited with exit code 1
>
> pg_basebackup: removing data directory "/tmp/bb"
>
>
>
>
>
> Here’s what it looks like with the patch applied locally:
>
>
>
> $ ./src/bin/pg_basebackup/pg_basebackup -p 5501 -D /tmp/bb -X stream -S SlotDoesNotExists -P
>
> pg_basebackup: error: could not send replication command "START_REPLICATION": ERROR: replication slot "SlotDoesNotExists" does not exist
>
> pg_basebackup: error: child process exited with exit code 1
>
> pg_basebackup: removing data directory "/tmp/bb"
Isn't this solving basically the same thing as
https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcommitfest.postgresql.org%2F34%2F3302%2F&data=04%7C01%7CDimitri.Fontaine%40microsoft.com%7C84c2d032a6d548beb6ca08d9826a46f3%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637684215249424989%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=BcCm8HBST8bDxbeUZopfdoXQCVES7NUBZ%2FJV3%2BJsZ9w%3D&reserved=0 (which does have Windows
support)? Does this implementations have some advantages over the one
Daniel posted, or should we just focus on that one since it does have
Windows support in it?
--
Magnus Hagander
Me: https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.hagander.net%2F&data=04%7C01%7CDimitri.Fontaine%40microsoft.com%7C84c2d032a6d548beb6ca08d9826a46f3%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637684215249424989%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=Qy8phvZAe46s27rP%2FahkfU6Z5%2FbbUlsFAGYTin6ViM4%3D&reserved=0
Work: https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.redpill-linpro.com%2F&data=04%7C01%7CDimitri.Fontaine%40microsoft.com%7C84c2d032a6d548beb6ca08d9826a46f3%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637684215249435007%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=HfTsMD1CEabJIR%2BzZQQC8R9ppXphNWcfYfnB67bWZcY%3D&reserved=0
pgsql-bugs by date: