Re: Zedstore - compressed in-core columnar storage - Mailing list pgsql-hackers

From Andres Freund
Subject Re: Zedstore - compressed in-core columnar storage
Date
Msg-id 20190414164510.idlavfnqkutj2h3u@alap3.anarazel.de
Whole thread Raw
In response to Re: Zedstore - compressed in-core columnar storage  (Tomas Vondra <tomas.vondra@2ndquadrant.com>)
Responses Re: Zedstore - compressed in-core columnar storage
List pgsql-hackers
Hi,

On 2019-04-14 18:36:18 +0200, Tomas Vondra wrote:
> I think those comparisons are cute and we did a fair amount of them when
> considering a drop-in replacement for pglz, but ultimately it might be a
> bit pointless because:
> 
> (a) it very much depends on the dataset (one algorithm may work great on
> one type of data, suck on another)
> 
> (b) different systems may require different trade-offs (high ingestion
> rate vs. best compression ratio)
> 
> (c) decompression speed may be much more important
> 
> What I'm trying to say is that we shouldn't obsess about picking one
> particular algorithm too much, because it's entirely pointless. Instead,
> we should probably design the system to support different compression
> algorithms, ideally at column level.

I think we still need to pick a default algorithm, and realistically
that's going to be used by like 95% of the users.

Greetings,

Andres Freund



pgsql-hackers by date:

Previous
From: Tomas Vondra
Date:
Subject: Re: Zedstore - compressed in-core columnar storage
Next
From: Tomas Vondra
Date:
Subject: Re: Zedstore - compressed in-core columnar storage