Re: getting the most of out multi-core systems for repeated complex SELECT statements - Mailing list pgsql-performance

From Vitalii Tymchyshyn
Subject Re: getting the most of out multi-core systems for repeated complex SELECT statements
Date
Msg-id 4D4FC351.4000105@gmail.com
Whole thread Raw
In response to Re: getting the most of out multi-core systems for repeated complex SELECT statements  (Chris Browne <cbbrowne@acm.org>)
List pgsql-performance
Hi, all

My small thoughts about parallelizing single query.
AFAIK in the cases where it is needed, there is usually one single
operation that takes a lot of CPU, e.g. hashing or sorting. And this are
usually tasks that has well known algorithms to parallelize.
The main problem, as for me, is thread safety. First of all, operations
that are going to be parallelized, must be thread safe. Then functions
and procedures they call must be thread safe too. So, a marker for a
procedure must be introduced and all standard ones should be
checked/fixed for parallel processing with marker set.
Then, one should not forget optimizer checks for when to introduce
parallelizing. How should it be accounted in the query plan? Should it
influence optimizer decisions (should it count CPU or wall time when
optimizing query plan)?
Or can it simply be used by an operation when it can see it will benefit
from it.

Best regards, Vitalii Tymchyshyn

pgsql-performance by date:

Previous
From: Greg Smith
Date:
Subject: Re: High load,
Next
From: Marti Raudsepp
Date:
Subject: Re: Really really slow select count(*)