Re: distinct estimate of a hard-coded VALUES list - Mailing list pgsql-hackers

From Tom Lane
Subject Re: distinct estimate of a hard-coded VALUES list
Date
Msg-id 2584.1471726705@sss.pgh.pa.us
Whole thread Raw
In response to Re: distinct estimate of a hard-coded VALUES list  (Jeff Janes <jeff.janes@gmail.com>)
Responses Re: distinct estimate of a hard-coded VALUES list  (Robert Haas <robertmhaas@gmail.com>)
List pgsql-hackers
Jeff Janes <jeff.janes@gmail.com> writes:
> On Thu, Aug 18, 2016 at 2:25 PM, Tom Lane <tgl@sss.pgh.pa.us> wrote:
>> It does know it, what it doesn't know is how many duplicates there are.

> Does it know whether the count comes from a parsed query-string list/array,
> rather than being an estimate from something else?  If it came from a join,
> I can see why it would be dangerous to assume they are mostly distinct.
> But if someone throws 6000 things into a query string and only 200 distinct
> values among them, they have no one to blame but themselves when it makes
> bad choices off of that.

I am not exactly sold on this assumption that applications have
de-duplicated the contents of a VALUES or IN list.  They haven't been
asked to do that in the past, so why do you think they are doing it?

>> If we do what I think you're suggesting, which is assume the entries are
>> all distinct, I'm afraid we'll just move the estimation problems somewhere
>> else.

> Any guesses as to where?  (other than the case of someone doing something
> silly with their query strings?)

Well, overestimates are as bad as underestimates --- it might lead us away
from using a nestloop, for example.
        regards, tom lane



pgsql-hackers by date:

Previous
From: Jeff Janes
Date:
Subject: Re: distinct estimate of a hard-coded VALUES list
Next
From: Tom Lane
Date:
Subject: Re: SP-GiST support for inet datatypes