Thread: pgsql: Allow partitionwise joins in more cases.

pgsql: Allow partitionwise joins in more cases.

From
Etsuro Fujita
Date:
Allow partitionwise joins in more cases.

Previously, the partitionwise join technique only allowed partitionwise
join when input partitioned tables had exactly the same partition
bounds.  This commit extends the technique to some cases when the tables
have different partition bounds, by using an advanced partition-matching
algorithm introduced by this commit.  For both the input partitioned
tables, the algorithm checks whether every partition of one input
partitioned table only matches one partition of the other input
partitioned table at most, and vice versa.  In such a case the join
between the tables can be broken down into joins between the matching
partitions, so the algorithm produces the pairs of the matching
partitions, plus the partition bounds for the join relation, to allow
partitionwise join for computing the join.  Currently, the algorithm
works for list-partitioned and range-partitioned tables, but not
hash-partitioned tables.  See comments in partition_bounds_merge().

Ashutosh Bapat and Etsuro Fujita, most of regression tests by Rajkumar
Raghuwanshi, some of the tests by Mark Dilger and Amul Sul, reviewed by
Dmitry Dolgov and Amul Sul, with additional review at various points by
Ashutosh Bapat, Mark Dilger, Robert Haas, Antonin Houska, Amit Langote,
Justin Pryzby, and Tomas Vondra

Discussion: https://postgr.es/m/CAFjFpRdjQvaUEV5DJX3TW6pU5eq54NCkadtxHX2JiJG_GvbrCA@mail.gmail.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/c8434d64ce03c32e0029417a82ae937f2055268f

Modified Files
--------------
doc/src/sgml/config.sgml                     |    6 +-
src/backend/nodes/outfuncs.c                 |    2 +
src/backend/optimizer/README                 |   27 +
src/backend/optimizer/path/joinrels.c        |  263 ++-
src/backend/optimizer/util/inherit.c         |    2 +
src/backend/optimizer/util/relnode.c         |   45 +-
src/backend/partitioning/partbounds.c        | 1865 ++++++++++++++++++
src/include/nodes/pathnodes.h                |    9 +-
src/include/partitioning/partbounds.h        |    9 +
src/test/regress/expected/partition_join.out | 2608 +++++++++++++++++++++++++-
src/test/regress/sql/partition_join.sql      |  639 ++++++-
11 files changed, 5392 insertions(+), 83 deletions(-)


Re: pgsql: Allow partitionwise joins in more cases.

From
Jeff Davis
Date:
On Wed, 2020-04-08 at 01:27 +0000, Etsuro Fujita wrote:
> Allow partitionwise joins in more cases.

This is causing a compiler warning for me if building without Asserts:

partbounds.c: In function ‘partition_bounds_merge’:
partbounds.c:1024:21: warning: unused variable ‘inner_binfo’ [-Wunused-
variable]
  PartitionBoundInfo inner_binfo = inner_rel->boundinfo;

Regards,
    Jeff Davis