Re: Different compression methods for FPI - Mailing list pgsql-hackers

From Michael Paquier
Subject Re: Different compression methods for FPI
Date
Msg-id YMqjMyXA6NwiFeXg@paquier.xyz
Whole thread Raw
In response to Re: Different compression methods for FPI  (Andrey Borodin <x4mmm@yandex-team.ru>)
Responses Re: Different compression methods for FPI
Re: Different compression methods for FPI
List pgsql-hackers
On Wed, Jun 16, 2021 at 01:17:26PM +0500, Andrey Borodin wrote:
> I agree that allowing just lz4 - is already a huge step ahead.

Yeah, I am tempted to just add LZ4 as a first step as the patch
footprint would be minimal, and we could come back to zstd once we
have more feedback from the field, if that's necessary.  As said
upthread, we have more flexibility with WAL than for the relation
data.

> But I'd suggest supporting zstd as well. Currently we only compress
> 8Kb chunks and zstd had no runaway to fully unwrap it's potential.
> In WAL-G we observed ~3x improvement in network utilisation when
> switched from lz4 to zstd in WAL archive compression.

You mean full segments here, right?  This has no need to be in core,
except if we want to add more compression options to pg_receivewal and
its friends?  That would be a nice addition, saying that.

> BTW we could get rid of whole hole-in-a-page thing if we would set
> lz4 as default. This could simplify FPI code.

Why would we do that?  We still need to support pglz as fallback if a
platform does not have LZ4, no?
--
Michael

Attachment

pgsql-hackers by date:

Previous
From: Tom Lane
Date:
Subject: Re: A qsort template
Next
From: Thomas Munro
Date:
Subject: Re: A qsort template