Re: Compression of bigger WAL records - Mailing list pgsql-hackers

From Fujii Masao
Subject Re: Compression of bigger WAL records
Date
Msg-id 87d08e95-0e55-4bcf-9f4b-5c9e7b8d91f8@oss.nttdata.com
Whole thread Raw
List pgsql-hackers

On 2025/01/22 3:24, Andrey M. Borodin wrote:
> 
> 
>> On 12 Jan 2025, at 17:43, Andrey M. Borodin <x4mmm@yandex-team.ru> wrote:
>>
>> I attach a prototype patch.
> 
> Here's v2, now it passes all the tests with wal_debug.

I like the idea of WAL compression more.

With the current approach, each backend needs to allocate memory twice
the size of the total WAL record. Right? One area is for the gathered
WAL record data (from rdt and registered_buffers), and the other is for
storing the compressed data. Could this lead to potential memory usage
concerns? Perhaps we should consider setting a limit on the maximum
memory each backend can use for WAL compression?

Regards,

-- 
Fujii Masao
Advanced Computing Technology Center
Research and Development Headquarters
NTT DATA CORPORATION




pgsql-hackers by date:

Previous
From: Andres Freund
Date:
Subject: Re: Interrupts vs signals
Next
From: Vladlen Popolitov
Date:
Subject: Re: EDB Installer initcluster script changes - review requested