Re: ZStandard (with dictionaries) compression support for TOAST compression - Mailing list pgsql-hackers

From Aleksander Alekseev
Subject Re: ZStandard (with dictionaries) compression support for TOAST compression
Date
Msg-id CAJ7c6TNUApmG9uHujg=wC0Suc8wP1VE1eSttd1KPthMoPuWGsw@mail.gmail.com
Whole thread Raw
In response to Re: ZStandard (with dictionaries) compression support for TOAST compression  (Robert Haas <robertmhaas@gmail.com>)
List pgsql-hackers
Hi Robert,

> I think that solving the problems around using a dictionary is going
> to be really hard. Can we see some evidence that the results will be
> worth it?

Compression dictionaries give a good compression ratio (~50%) and also
increase TPS a bit (5-10%) due to better buffer cache utilization. At
least according to synthetic and not trustworthy benchmarks I did some
years ago [1]. The result may be very dependent on the actual data of
course, not to mention particular implementation of the idea.

[1]: https://github.com/afiskon/zson/blob/master/docs/benchmark.md

-- 
Best regards,
Aleksander Alekseev



pgsql-hackers by date:

Previous
From: Amit Kapila
Date:
Subject: Re: Selectively invalidate caches in pgoutput module
Next
From: Amit Kapila
Date:
Subject: Re: Add contrib/pg_logicalsnapinspect