Re: pg_receivewal/xlog to ship wal to cloud - Mailing list pgsql-general

From Alan Hodgson
Subject Re: pg_receivewal/xlog to ship wal to cloud
Date
Msg-id 642533227fe8b6782c8f55bfdc4be49a0060f30d.camel@lists.simkin.ca
Whole thread Raw
In response to pg_receivewal/xlog to ship wal to cloud  (neslişah demirci <neslisah.demirci@gmail.com>)
Responses Re: pg_receivewal/xlog to ship wal to cloud  (Ganesh Korde <ganeshakorde@gmail.com>)
List pgsql-general
On Mon, 2022-07-18 at 15:55 -0400, neslişah demirci wrote:
> Hi all, 
>
> Wondering if anyone has any experience of using pg_receivewal/xlog
> to ship wal files to GCP/S3?
>

I use archive_command to send WAL to S3. It works fine. I do gzip
them before uploading, as they are usually pretty compressible.

I use a lifecycle rule on the bucket to automatically delete ones
older than I might need.

It's not the fastest process in the world, and replay on our
reporting server does occasionally fall behind, but I think that's
true of WAL replay in general as a serialized process.



pgsql-general by date:

Previous
From: neslişah demirci
Date:
Subject: Re: pg_receivewal/xlog to ship wal to cloud
Next
From: Håvar Nøvik
Date:
Subject: How to handle failed COMMIT