Re: Parallel Seq Scan - Mailing list pgsql-hackers

From Tom Lane
Subject Re: Parallel Seq Scan
Date
Msg-id 30774.1422460186@sss.pgh.pa.us
Whole thread Raw
In response to Re: Parallel Seq Scan  (Robert Haas <robertmhaas@gmail.com>)
List pgsql-hackers
Robert Haas <robertmhaas@gmail.com> writes:
> On Wed, Jan 28, 2015 at 10:40 AM, Tom Lane <tgl@sss.pgh.pa.us> wrote:
>> I thought the proposal to chunk on the basis of "each worker processes
>> one 1GB-sized segment" should work all right.  The kernel should see that
>> as sequential reads of different files, issued by different processes;
>> and if it can't figure out how to process that efficiently then it's a
>> very sad excuse for a kernel.

> I agree.  But there's only value in doing something like that if we
> have evidence that it improves anything.  Such evidence is presently a
> bit thin on the ground.

Well, of course none of this should get committed without convincing
evidence that it's a win.  But I think that chunking on relation segment
boundaries is a plausible way of dodging the problem that we can't do
explicitly hardware-aware scheduling.
        regards, tom lane



pgsql-hackers by date:

Previous
From: Andres Freund
Date:
Subject: Re: Misaligned BufferDescriptors causing major performance problems on AMD
Next
From: Stephen Frost
Date:
Subject: Re: Parallel Seq Scan