Re: libpq compression - Mailing list pgsql-hackers

From Konstantin Knizhnik
Subject Re: libpq compression
Date
Msg-id a13ce4d1-768c-1449-25f6-0cd645499d93@postgrespro.ru
Whole thread Raw
In response to Re: libpq compression  ("Andrey M. Borodin" <x4mmm@yandex-team.ru>)
Responses Re: libpq compression  (Konstantin Knizhnik <k.knizhnik@postgrespro.ru>)
List pgsql-hackers
On 06.10.2020 9:34, Andrey M. Borodin wrote:
>
>> 26 марта 2019 г., в 19:46, Konstantin Knizhnik <k.knizhnik@postgrespro.ru> написал(а):
>>
>> Version of the patch correctly working when no compression algorithm are avaiable.
> Thanks for this work, Konstantin.
> PFA rebased version of this patch.
>
> This compression seems very important to reduce network-induced replication lag.
> Recently I've found out that small installation suffer from huge latency spike when archive_timeout occurs.
> How this happens? archive_timeout emits segment switch, which pads current segment with zeroes. Now these zeroes need
tobe replicated to standbys, without compression. Transfer of zeroes causes long waits for synchronous replication (up
to1s with network restricted to 16Mbps).
 
>
> Also replication compression will reduce overall cross-AZ traffic of HA installations.
>
> So I'm considering following plan for 2020: implement this protocol in Odyssey and send patches to drivers to enable
earlyaccess to this feature.
 
>
> Best regards, Andrey Borodin.

Rebased version of the patch is attached.
I am going to resubmit it to the next CF.


Attachment

pgsql-hackers by date:

Previous
From: Magnus Hagander
Date:
Subject: Re: A new function to wait for the backend exit after termination
Next
From: "David G. Johnston"
Date:
Subject: Re: A new function to wait for the backend exit after termination