Re: Proposal: speeding up GIN build with parallel workers - Mailing list pgsql-hackers

From Robert Haas
Subject Re: Proposal: speeding up GIN build with parallel workers
Date
Msg-id CA+TgmoYf68hmRsUMkqLkAAgEYGdKMbbDgxJgE6JjjJi02CHuaw@mail.gmail.com
Whole thread Raw
In response to Proposal: speeding up GIN build with parallel workers  ("Constantin S. Pan" <kvapen@gmail.com>)
List pgsql-hackers
On Fri, Jan 15, 2016 at 5:38 PM, Constantin S. Pan <kvapen@gmail.com> wrote:
> In current state the implementation is just a proof of concept
> and it has all the configuration hardcoded, but it already works as is,
> though it does not speed up the build process more than 4 times on my
> configuration (12 CPUs). There is also a problem with temporary tables,
> for which the parallel mode does not work.

I have yet to see a case where parallel query, with any current or
pending patch, gets more than about a 4x speedup.  I can't think of
any reason that there should be a wall at 4x, and I'm not sure we're
hitting the wall there for the same reason in all cases.  But your
observation corresponds to my experience.

I hope we eventually figure out how to make that much better, but I
wouldn't feel too bad about being at that spot now.  4x faster is
still a lot faster.

-- 
Robert Haas
EnterpriseDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company



pgsql-hackers by date:

Previous
From: Robert Haas
Date:
Subject: Re: [PATCH] Improve spinlock inline assembly for x86.
Next
From: Robert Haas
Date:
Subject: Re: Cannot find a working 64-bit integer type