Re: Having some problems with concurrent COPY commands - Mailing list pgsql-performance

From Andres Freund
Subject Re: Having some problems with concurrent COPY commands
Date
Msg-id 20151012182808.GB10323@awork2.anarazel.de
Whole thread Raw
In response to Having some problems with concurrent COPY commands  (Shaun Thomas <bonesmoses@gmail.com>)
Responses Re: Having some problems with concurrent COPY commands
List pgsql-performance
Hi,

On 2015-10-12 13:17:53 -0500, Shaun Thomas wrote:
> It would appear I'm running into whatever issue the xloginsert_slots patch
> tried to address, but not much discussion exists afterwards.

That patch is merged, it's just that the number of slots is
hardcoded. You can recompile postgres with different values by changing
#define NUM_XLOGINSERT_LOCKS  8
in xlog.c to a different value. A restart is enough afterwards.

> Is there any other way to
> get normal parallel COPY performance, or is that just currently impossible?
>
> I also know 9.5 underwent a lot of locking improvements, so it might
> not be relevant. I just haven't gotten a chance to repeat my tests
> with 9.5 just yet.

Hard to say anything substantive without further information. Any chance
you could provide profiles of such a run? If yes, I can help you with
instructions. I'm just to lazy to write them up if not.

Greetings,

Andres Freund


pgsql-performance by date:

Previous
From: Shaun Thomas
Date:
Subject: Having some problems with concurrent COPY commands
Next
From: Jeff Janes
Date:
Subject: Re: Having some problems with concurrent COPY commands