Re: libpq compression - Mailing list pgsql-hackers

From Andrey M. Borodin
Subject Re: libpq compression
Date
Msg-id 74F0A385-6ED4-4EA7-9498-1A8527F16472@yandex-team.ru
Whole thread Raw
In response to libpq compression  (Konstantin Knizhnik <k.knizhnik@postgrespro.ru>)
Responses Re: libpq compression  (Konstantin Knizhnik <k.knizhnik@postgrespro.ru>)
List pgsql-hackers

> 26 марта 2019 г., в 19:46, Konstantin Knizhnik <k.knizhnik@postgrespro.ru> написал(а):
>
> Version of the patch correctly working when no compression algorithm are avaiable.

Thanks for this work, Konstantin.
PFA rebased version of this patch.

This compression seems very important to reduce network-induced replication lag.
Recently I've found out that small installation suffer from huge latency spike when archive_timeout occurs.
How this happens? archive_timeout emits segment switch, which pads current segment with zeroes. Now these zeroes need
tobe replicated to standbys, without compression. Transfer of zeroes causes long waits for synchronous replication (up
to1s with network restricted to 16Mbps). 

Also replication compression will reduce overall cross-AZ traffic of HA installations.

So I'm considering following plan for 2020: implement this protocol in Odyssey and send patches to drivers to enable
earlyaccess to this feature. 

Best regards, Andrey Borodin.

Attachment

pgsql-hackers by date:

Previous
From: Bharath Rupireddy
Date:
Subject: Re: Use standard SIGHUP and SIGTERM handlers in autoprewarm module
Next
From: Bharath Rupireddy
Date:
Subject: Re: Logical Replication - detail message with names of missing columns