Re: Zedstore - compressed in-core columnar storage - Mailing list pgsql-hackers

From Andres Freund
Subject Re: Zedstore - compressed in-core columnar storage
Date
Msg-id 20190415182751.ngrwpub6wj3xxnlw@alap3.anarazel.de
Whole thread Raw
In response to Re: Zedstore - compressed in-core columnar storage  (Robert Haas <robertmhaas@gmail.com>)
List pgsql-hackers
Hi,

On 2019-04-15 14:11:02 -0400, Robert Haas wrote:
> Furthermore, different table AMs are going to have different
> needs.  It has already been remarked by both Andres and on this thread
> that for columnar storage to really zip along, the executor is going
> to need to be much smarter about deciding which columns to request.
> Presumably there will be a market for planner/executor optimizations
> that postpone fetching columns for as long as possible.  It's not
> going to be maintainable to build that kind of infrastructure in core
> and then have no in-core user of it.

Right. Two notes on that: A lot of that infrastructure needed for fast
query execution (both plan time and execution time) is also going to be
useful for a row store like heap, even though it won't have the
~order-of-magnitude impacts it can have for column stores. Secondly,
even without those, the storage density alone can make column stores
worthwhile, even without query execution speedups (or even slowdowns).

Greetings,

Andres Freund



pgsql-hackers by date:

Previous
From: Andres Freund
Date:
Subject: Re: Zedstore - compressed in-core columnar storage
Next
From: Tom Lane
Date:
Subject: Re: Zedstore - compressed in-core columnar storage