Re: Multi CPU Queries - Feedback and/or suggestions wanted! - Mailing list pgsql-hackers

From Jeffrey Baker
Subject Re: Multi CPU Queries - Feedback and/or suggestions wanted!
Date
Msg-id fd145f7d0810202225p30f6191cv33b05da0a0142085@mail.gmail.com
Whole thread Raw
In response to Multi CPU Queries - Feedback and/or suggestions wanted!  (Julius Stroffek <Julius.Stroffek@Sun.COM>)
Responses Re: Multi CPU Queries - Feedback and/or suggestions wanted!
Re: Multi CPU Queries - Feedback and/or suggestions wanted!
List pgsql-hackers
On Mon, Oct 20, 2008 at 12:05 PM, Julius Stroffek <Julius.Stroffek@sun.com> wrote:
Topics that seem to be of interest and most of them were already
discussed at developers meeting in Ottawa are
1.) parallel sorts
2.) parallel query execution
3.) asynchronous I/O
4.) parallel COPY
5.) parallel pg_dump
6.) using threads for parallel processing
[...]
2.)
Different subtrees (or nodes) of the plan could be executed in parallel
on different CPUs and the results of this subtrees could be requested
either synchronously or asynchronously.

I don't see why multiple CPUs can't work on the same node of a plan.  For instance, consider a node involving a scan with an expensive condition, like UTF-8 string length.  If you have four CPUs you can bring to bear, each CPU could take every fourth page, computing the expensive condition for each tuple in that page.  The results of the scan can be retired asynchronously to the next node above.

-jwb

pgsql-hackers by date:

Previous
From: ITAGAKI Takahiro
Date:
Subject: pg_stat_statements in core
Next
From: tomas@tuxteam.de
Date:
Subject: Re: Debian no longer dumps cores?