Thread: pg_receivewal/xlog to ship wal to cloud
Hi all,
Wondering if anyone has any experience of using pg_receivewal/xlog to ship wal files to GCP/S3?
Could you please share ideas or issues you had?
Thanks.
Or downloading from cloud experience?
neslişah demirci <neslisah.demirci@gmail.com>, 18 Tem 2022 Pzt, 15:55 tarihinde şunu yazdı:
Hi all,Wondering if anyone has any experience of using pg_receivewal/xlog to ship wal files to GCP/S3?Could you please share ideas or issues you had?Thanks.
Best,
NeslisahOn Mon, 2022-07-18 at 15:55 -0400, neslişah demirci wrote: > Hi all, > > Wondering if anyone has any experience of using pg_receivewal/xlog > to ship wal files to GCP/S3? > I use archive_command to send WAL to S3. It works fine. I do gzip them before uploading, as they are usually pretty compressible. I use a lifecycle rule on the bucket to automatically delete ones older than I might need. It's not the fastest process in the world, and replay on our reporting server does occasionally fall behind, but I think that's true of WAL replay in general as a serialized process.
On Tue, 19 Jul 2022, 2:09 am Alan Hodgson, <ahodgson@lists.simkin.ca> wrote:
On Mon, 2022-07-18 at 15:55 -0400, neslişah demirci wrote:
> Hi all,
>
> Wondering if anyone has any experience of using pg_receivewal/xlog
> to ship wal files to GCP/S3?
>
I use archive_command to send WAL to S3. It works fine. I do gzip
them before uploading, as they are usually pretty compressible.
I use a lifecycle rule on the bucket to automatically delete ones
older than I might need.
It's not the fastest process in the world, and replay on our
reporting server does occasionally fall behind, but I think that's
true of WAL replay in general as a serialized process.
Have a look at this also.