Thread: [GENERAL] PostgreSQL and Data Warehouse optimizations

[GENERAL] PostgreSQL and Data Warehouse optimizations

From

Daniel Franco

Date:

01 August 2017, 04:52:28

Recently, I've been doing a research about data warehouse optimizations and techniques. For example, Oracle uses parallel queries, materialized views with different refresh modes, star transformations in queries, etc. Since I've never worked with PostgreSQL in an OLAP environment, I thought maybe the community could guide me to find what features and techniques PostgreSQL provides for its users and it would be especially useful if someone could point out a previous work comparing PostgreSQL with another RDBMs in this regard. Also, I'm interested if there's any interesting books, articles or anything related PostgreSQL and Data Warehouses optimizations.

Thanks and Regards for all the community.

Livre de vírus. www.avast.com.

Re: PostgreSQL and Data Warehouse optimizations

From

legrand legrand

Date:

02 December 2017, 02:38:59

Hi,

Parallel Queries are now available and development is very active for
Declarative Partitioning (arrived with pg 10),
many new features are currently developped in pg 11, (for exemple hash
partition, partition wise ... most regarding partition usage optimizations)
see https://commitfest.postgresql.org/16/

There are also many works regarding Sharding (using FDW with remote
partitions) and pocs regarding compression, vectorization ...

I'm like you, I very interested in dataware house / datamart / OLAP queries
...
I've asked about
http://www.postgresql-archive.org/Partition-pruning-agg-push-down-for-star-schema-in-pg-v11-td5994678.html
that seems to me a kind of pre-requisite before trying to migrate ...

Sure pg 11 will be great for us ;o)

Regards
PAscal



--
Sent from: http://www.postgresql-archive.org/PostgreSQL-general-f1843780.html