Re: wal segment size - Mailing list pgsql-general

From Colin 't Hart
Subject Re: wal segment size
Date
Msg-id CAMon-aSkPs=N5GHJsOzLs5RKcrba3=ng_6HUEKZy1=1GJgCEqg@mail.gmail.com
Whole thread Raw
In response to Re: wal segment size  (Laurenz Albe <laurenz.albe@cybertec.at>)
Responses Re: wal segment size
Re: wal segment size
Re: wal segment size
List pgsql-general
Thanks Laurenz, that confirms what I was assuming. Archiving is via pgbackrest to a backup server, over SSH. Approx 750ms to archive each segment is crazy -- I'll check compression parameters too.

Any reason not to bump it up to 1GB? Or is that overkill?

/Colin

On Wed, 17 Dec 2025 at 16:25, Laurenz Albe <laurenz.albe@cybertec.at> wrote:
On Wed, 2025-12-17 at 16:13 +0100, Colin 't Hart wrote:
> I see very little advice on tuning WAL segment size.
>
> One of my clients has a few datawarehouses at around 8 - 16 TB
>
> On one of the nodes there are approx 15000 WAL segments of 16MB each, totalling
> approx 230GB. The archiver is archiving approx one per second, so approx 4 hours to clear.
>
> Would we gain anything by bumping the WAL segment size?

Very likely yes, if the problem is the overhead of starting the archive_command.

Another thing that can slow down archiving is if you compress these segments
too aggressively.

Yours,
Laurenz Albe

pgsql-general by date:

Previous
From: Ron Johnson
Date:
Subject: Re: wal segment size
Next
From: Matthias Leisi
Date:
Subject: Re: Record last SELECT on a row?