Re: Zedstore - compressed in-core columnar storage - Mailing list pgsql-hackers

From Tom Lane
Subject Re: Zedstore - compressed in-core columnar storage
Date
Msg-id 11257.1554994460@sss.pgh.pa.us
Whole thread Raw
In response to Re: Zedstore - compressed in-core columnar storage  (Ashwin Agrawal <aagrawal@pivotal.io>)
Responses Re: Zedstore - compressed in-core columnar storage
List pgsql-hackers
Ashwin Agrawal <aagrawal@pivotal.io> writes:
> Thank you for trying it out. Yes, noticed for certain patterns pg_lzcompress() actually requires much larger output
buffers.Like for one 86 len source it required 2296 len output buffer. Current zedstore code doesn’t handle this case
anderrors out. LZ4 for same patterns works fine, would highly recommend using LZ4 only, as anyways speed is very fast
aswell with it. 

You realize of course that *every* compression method has some inputs that
it makes bigger.  If your code assumes that compression always produces a
smaller string, that's a bug in your code, not the compression algorithm.

            regards, tom lane



pgsql-hackers by date:

Previous
From: Tom Lane
Date:
Subject: Re: creating gist index seems to look at data ignoring transaction?
Next
From: Jeevan Chalke
Date:
Subject: cache lookup failed for collation 0