Re: Parallel WAL Archival Options - Mailing list pgsql-admin

From Nikhil Shetty
Subject Re: Parallel WAL Archival Options
Date
Msg-id CAFpL5VxaNyri4A9xGz2EVoGJpAsze_ucu-6=Xg_kxA6bm9fdjQ@mail.gmail.com
Whole thread Raw
In response to Re: Parallel WAL Archival Options  (Stephen Frost <sfrost@snowman.net>)
List pgsql-admin
Thanks Stephen , I'll check it out.

On Mon, 7 Aug 2023 at 20:12, Stephen Frost <sfrost@snowman.net> wrote:
Greetings,

* Nikhil Shetty (nikhil.dba04@gmail.com) wrote:
> I would like to know which backup&restore tools will be better for
> scenarios where the database is generating around 400 WALs per minute.
>
> We are using wal-g but it is not able to keep pace with the wal generation.
> We increased the upload streams to 256 but no luck

pgbackrest also does parallel WAL archiving and is able to handle
large volumes of WAL and we'd love to hear how well it works for you.

Feel free to reach out via a github issue if you have trouble making it
able to keep up.

Do be sure to also test that you're able to actually perform restores in
whatever timeframe you expect to be able to with that kind of WAL
generation.

Thanks,

Stephen

pgsql-admin by date:

Previous
From: Stephen Frost
Date:
Subject: Re: Parallel WAL Archival Options
Next
From: Jerry Sievers
Date:
Subject: ignore_system_indexes=on no help for missing/corrupt pg_class_oid_index?