Re: window function induces full table scan - Mailing list pgsql-performance

From Jeff Janes
Subject Re: window function induces full table scan
Date
Msg-id CAMkU=1zcZH+7_kzAS_jWR-soz7YWUeu6nYeTtAMhiDt6BQKTpw@mail.gmail.com
Whole thread Raw
In response to Re: window function induces full table scan  (Tom Lane <tgl@sss.pgh.pa.us>)
Responses Re: window function induces full table scan
List pgsql-performance
On Thu, Jan 2, 2014 at 1:52 PM, Tom Lane <tgl@sss.pgh.pa.us> wrote:
Thomas Mayer <thomas.mayer@student.kit.edu> writes:
> When querying a view with a WHERE condition, postgresql normally is able
> to perform an index scan which reduces time for evaluation dramatically.

> However, if a window function is evaluated in the view, postgresql is
> evaluating the window function before the WHERE condition is applied.
> This induces a full table scan.

You haven't exactly provided full details, but it looks like you are
thinking that WHERE clauses applied above a window function should
be pushed to below it.  A moment's thought about the semantics should
convince you that such an optimization would be incorrect: the window
function would see fewer input rows than it should, and therefore would
(in general) return the wrong values for the selected rows.

It's possible that in the specific case you exhibit here, pushing down
the clause wouldn't result in changes in the window function's output for
the selected rows, but the optimizer doesn't have enough knowledge about
window functions to determine that.

A restriction in the WHERE clause which corresponds to the PARTITION BY should be pushable, no?  I think it doesn't need to understand the internal semantics of the window function itself, just of the PARTITION BY, which should be doable, at least in principle.

Cheers,

Jeff

pgsql-performance by date:

Previous
From: Tom Lane
Date:
Subject: Re: window function induces full table scan
Next
From: Tom Lane
Date:
Subject: Re: window function induces full table scan