RE: I'd like to discuss scaleout at PGCon - Mailing list pgsql-hackers

From Tsunakawa, Takayuki
Subject RE: I'd like to discuss scaleout at PGCon
Date
Msg-id 0A3221C70F24FB45833433255569204D1F9A048F@G01JPEXMBYT05
Whole thread Raw
In response to Re: I'd like to discuss scaleout at PGCon  (Konstantin Knizhnik <k.knizhnik@postgrespro.ru>)
List pgsql-hackers
> From: Konstantin Knizhnik [mailto:k.knizhnik@postgrespro.ru]
> I can not completely agree with it. I have done a lot of benchmarking of
> PostgreSQL, CitusDB, SparkSQL and native C/Scala code generated for
> TPC-H queries.

Wow, you have an amazingly abundant experience.


> I do not want to say that it is not possible to implement good analytic
> platform for OLAP on top of Postgres. But it is very challenged task.
> And IMHO choice of programming language is not so important. What is
> more important is format of storing data. The bast systems for data
> analytic: Vartica, HyPer, KDB,...
> are using vertical data mode. SparkSQL is also using Parquet file format
> which provides efficient extraction and processing of data.
> With abstract storage API Postgres is also given a chance to implement
> efficient storage for OLAP data processing. But huge amount of work has
> to be done here.

Agreed on huge amount of work... And I must admit my dream is a pipedream now.


Regards
Takayuki Tsunakawa


pgsql-hackers by date:

Previous
From: "Tsunakawa, Takayuki"
Date:
Subject: RE: I'd like to discuss scaleout at PGCon
Next
From: Amit Langote
Date:
Subject: Fix obsolete comment