Thread: query optimizer
Hello,
As I see the documentation of postgres, postgres use genetic algorithm for query optimization rather than system R optimizer. right?
--
Jungmin Shin
"jungmin shin" <jungmin.shin@gmail.com> writes:
> As I see the documentation of postgres, postgres use genetic algorithm for
> query optimization rather than system R optimizer. right?
Only for queries with more than geqo_threshold relations. The join
search algorithm for smaller queries is a System-R-like dynamic
programming method.
regards, tom lane
On Tuesday 17 April 2007 Tom Lane's cat, walking on the keyboard, wrote: > "jungmin shin" <jungmin.shin@gmail.com> writes: > > As I see the documentation of postgres, postgres use genetic algorithm > > for query optimization rather than system R optimizer. right? > > Only for queries with more than geqo_threshold relations. The join > search algorithm for smaller queries is a System-R-like dynamic > programming method. > Hi, I'd like to better understand how the optimizer works and is implemented. Is there any available documentation (before start reading the source!) to understand concepts about geqo and system r? Any chance about any demo or presentation with detailed examples (about how the optimizer makes and discards choices, not about how to read the planner output)? Thanks, Luca
Luca Ferrari <fluca1978@infinito.it> writes: > I'd like to better understand how the optimizer works and is implemented. Is > there any available documentation (before start reading the source!) to > understand concepts about geqo and system r? Any chance about any demo or > presentation with detailed examples (about how the optimizer makes and > discards choices, not about how to read the planner output)? http://developer.postgresql.org/pgdocs/postgres/overview.html (particularly 42.5) src/backend/optimizer/README The developers section of the website used to have slides from a couple of talks I gave at OSCON, but I don't see them there anymore :-( regards, tom lane
On Thu, 19 Jul 2007, Tom Lane wrote: > The developers section of the website used to have slides from a couple > of talks I gave at OSCON, but I don't see them there anymore :-( This one is still around: http://conferences.oreillynet.com/presentations/os2003/lane_tom.pdf I'd also recommend http://www.gtsm.com/oscon2003/toc.html on this topic. -- * Greg Smith gsmith@gregsmith.com http://www.gregsmith.com Baltimore, MD
On Thu, Jul 19, 2007 at 10:41:03AM -0400, Tom Lane wrote: > Luca Ferrari <fluca1978@infinito.it> writes: > > I'd like to better understand how the optimizer works and is implemented. Is > > there any available documentation (before start reading the source!) to > > understand concepts about geqo and system r? Any chance about any demo or > > presentation with detailed examples (about how the optimizer makes and > > discards choices, not about how to read the planner output)? > > http://developer.postgresql.org/pgdocs/postgres/overview.html > (particularly 42.5) > > src/backend/optimizer/README > > The developers section of the website used to have slides from a couple > of talks I gave at OSCON, but I don't see them there anymore :-( How long ago was this (that they were on the website)? I don't recall that ever being removed, and I can't find it in the cvs either. If you still have the presentations, we can always add them back in... (I recall reading them, but don't have a local copy) //Magnus
Magnus Hagander <magnus@hagander.net> writes: > On Thu, Jul 19, 2007 at 10:41:03AM -0400, Tom Lane wrote: >> The developers section of the website used to have slides from a couple >> of talks I gave at OSCON, but I don't see them there anymore :-( > How long ago was this (that they were on the website)? I don't recall that > ever being removed, and I can't find it in the cvs either. Hmm, I thought they were once on the same page as Bruce's papers, now http://www.postgresql.org/developer/coding but possibly I'm mistaken; it was well before the website reorg anyway. > If you still have the presentations, we can always add them back in... (I > recall reading them, but don't have a local copy) Yeah, the PDFs are still in my home directory on cvs.postgresql.org. regards, tom lane
Magnus Hagander wrote: > On Thu, Jul 19, 2007 at 10:41:03AM -0400, Tom Lane wrote: > > The developers section of the website used to have slides from a couple > > of talks I gave at OSCON, but I don't see them there anymore :-( > > How long ago was this (that they were on the website)? I don't recall that > ever being removed, and I can't find it in the cvs either. > > If you still have the presentations, we can always add them back in... (I > recall reading them, but don't have a local copy) Last time I asked, I found them in Tom's home dir in cvs.postgresql.org. -- Alvaro Herrera http://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7 support
On Thursday 19 July 2007 Tom Lane's cat, walking on the keyboard, wrote: > http://developer.postgresql.org/pgdocs/postgres/overview.html > (particularly 42.5) I have already read this, thanks. > > src/backend/optimizer/README I've read this yesterday, very interesting, but I'm looking for something similar related to geqo. I mean, is there any presentation/demo that step-y-step explains how geqo could take decisions? Thanks, Luca
Luca Ferrari <fluca1978@infinito.it> writes: >> src/backend/optimizer/README > I've read this yesterday, very interesting, but I'm looking for something > similar related to geqo. I mean, is there any presentation/demo that > step-y-step explains how geqo could take decisions? There's not a lot, but I just made a few improvements here and here: http://developer.postgresql.org/pgdocs/postgres/planner-optimizer.html http://developer.postgresql.org/pgdocs/postgres/geqo-pg-intro.html Beyond that, the GEQO chapter provides several references, and IMHO you should not be all that resistant to looking into the source code. Even if you don't read C well, many of the files provide a wealth of info in the comments. regards, tom lane
Tom Lane wrote: > Magnus Hagander <magnus@hagander.net> writes: >> On Thu, Jul 19, 2007 at 10:41:03AM -0400, Tom Lane wrote: >>> The developers section of the website used to have slides from a couple >>> of talks I gave at OSCON, but I don't see them there anymore :-( > >> How long ago was this (that they were on the website)? I don't recall that >> ever being removed, and I can't find it in the cvs either. > > Hmm, I thought they were once on the same page as Bruce's papers, now > http://www.postgresql.org/developer/coding > but possibly I'm mistaken; it was well before the website reorg anyway. > >> If you still have the presentations, we can always add them back in... (I >> recall reading them, but don't have a local copy) > > Yeah, the PDFs are still in my home directory on cvs.postgresql.org. Added to the website, will appear on next build. //Magnus
On Saturday 21 July 2007 Tom Lane's cat, walking on the keyboard, wrote: > Beyond that, the GEQO chapter provides several references, and IMHO > you should not be all that resistant to looking into the source code. > Even if you don't read C well, many of the files provide a wealth of > info in the comments. Thanks for you integration and, even if I'm not a C-expert, I'd like to read the source code to better understand how postgres works. Nevertheless, since the source code can be very long, it should be better to have a kind of uml diagram or something similar to understand on which point of code to focus on. That's what I was looking for. Luca