Trying to understand Stats/Query planner issue - Mailing list pgsql-performance

From Strange, John W
Subject Trying to understand Stats/Query planner issue
Date
Msg-id D86EB8F058615F40948C622359204B3F02F63E194C@EMASC201VS01.exchad.jpmchase.net
Whole thread Raw
Responses Re: Trying to understand Stats/Query planner issue
List pgsql-performance

I have a question on how the analyzer works in this type of scenario.

 

We calculate some results and COPY INTO some partitioned tables, which we use some selects to aggregate the data back out into reports.  Everyone once in a while the aggregation step picks a bad plan due to stats on the tables that were just populated.   Updating the stats and rerunning the query seems to solve the problem, this only happens if we enable nested loop query plans.

 

Which leads me to a few questions:

 

Assumption: that starts aren’t getting created fast enough and then the query planner then picks a bad plan since we query the tables shortly after being populated, so it decided to use a nested loop on a large set of results incorrectly.

 

- if there are no stats on the table how does the query planner identify the best query plan?

- we have tried really aggressive auto_analyze settings down to .001, so basically any insert will get the analyze running with no luck.

- will an analyze block on update to the statistics tables, which makes me wonder if we are updating too often?

 

The other option is just to analyze each table involved in the query after the insert, but that seems a bit counterproductive.

 

Thoughts?

_______________________________________________________________________________________________
| John W. Strange | Vice President | Global Commodities Technology
| J.P. Morgan | 700 Louisiana, 11th Floor | T: 713-236-4122 | C: 281-744-6476 | F: 713 236-3333
|
john.w.strange@jpmchase.com | jpmorgan.com

 

This email is confidential and subject to important disclaimers and conditions including on offers for the purchase or sale of securities, accuracy and completeness of information, viruses, confidentiality, legal privilege, and legal entity disclaimers, available at http://www.jpmorgan.com/pages/disclosures/email.

pgsql-performance by date:

Previous
From: Lucas Mocellin
Date:
Subject: Re: Performance Problem with postgresql 9.03, 8GB RAM,Quadcore Processor Server--Need help!!!!!!!
Next
From: kzsolt
Date:
Subject: Re: Heavy contgnous load