Re: Calculate total_table_pages after set_base_rel_sizes() - Mailing list pgsql-hackers

From Edmund Horner
Subject Re: Calculate total_table_pages after set_base_rel_sizes()
Date
Msg-id CAMyN-kDw19SopObb59B3xf9ywXfZ6MBkg9mkya=90_azowBe8A@mail.gmail.com
Whole thread Raw
In response to Re: Calculate total_table_pages after set_base_rel_sizes()  (David Rowley <david.rowley@2ndquadrant.com>)
Responses Re: Calculate total_table_pages after set_base_rel_sizes()  (David Rowley <david.rowley@2ndquadrant.com>)
List pgsql-hackers
David Rowley said:
> I believe that we should be delaying the PlannerInfo's
> total_table_pages calculation until after constraint exclusion and
> partition pruning have taken place. Doing this calculation before we
> determine which relations we don't need to scan can lead to
> incorrectly applying random_page_cost to too many pages processed
> during an Index Scan.
>
> We already don't count relations removed by join removals from this
> calculation, so counting pruned partitions seems like an omission.
>
> The attached patch moves the calculation to after set_base_rel_sizes()
> is called and before set_base_rel_pathlists() is called, where the
> information is actually used.
>
> I am considering this a bug fix, but I'm proposing this for PG12 only
> as I don't think destabilising plans in the back branches is a good
> idea. I'll add this to the September commitfest.

I played with the new patched today with a set of large partitions.
It seems to work, though the effect is subtle.  The expected behaviour
of index_pages_fetched is a bit hard to fathom when the cache share
pushes it between cases A,B and C of the formula, but that's not
really down to this patch.

Basically I think it's ready for a committer to look at.  Should I
update the CF entry?

Edmund


pgsql-hackers by date:

Previous
From: Andrew Gierth
Date:
Subject: Re: Performance improvements for src/port/snprintf.c
Next
From: Michael Paquier
Date:
Subject: Re: Assertion failure with ALTER TABLE ATTACH PARTITION withlog_min_messages >= DEBUG1