Re: Speed difference between select ... union select ... and select from partitioned_table - Mailing list pgsql-performance

From Pablo Alcaraz
Subject Re: Speed difference between select ... union select ... and select from partitioned_table
Date
Msg-id 4723BC36.8000300@laotraesquina.com.ar
Whole thread Raw
In response to Re: Speed difference between select ... union select ... and select from partitioned_table  (Pablo Alcaraz <pabloa@laotraesquina.com.ar>)
List pgsql-performance
Pablo Alcaraz wrote:
These are the EXPLAIN ANALIZE:


If you raise work_mem enough to let the second query use a hash
aggregate (probably a few MB would do it), I think it'll be about
the same speed as the first one.

The reason it's not picking that on its own is the overestimate
of the number of resulting groups.  This is because
get_variable_numdistinct is not smart about append relations.
We should try to fix that sometime...


I re run the partitioned-query. it completed in 15996 seconds. It builded a BIG temp file:

[root@igor xxx]# ls -lh pgsql-data/data/16386/pgsql_tmp/
total 2.2G
-rw------- 1 postgres postgres 1.0G Oct 27 15:35 pgsql_tmp7004.0
-rw------- 1 postgres postgres 1.0G Oct 27 15:35 pgsql_tmp7004.1
-rw------- 1 postgres postgres 175M Oct 27 15:35 pgsql_tmp7004.2

work_mem=1Mb. How much do I need to raise work_mem variable? 2.2G?

Regards

Pablo

pgsql-performance by date:

Previous
From: "Luke Lonergan"
Date:
Subject: Re: partitioned table and ORDER BY indexed_field DESCLIMIT 1
Next
From: Gregory Stark
Date:
Subject: Re: partitioned table and ORDER BY indexed_field DESC LIMIT 1