Re: COPY FROM performance improvements - Mailing list pgsql-patches

From Mark Wong
Subject Re: COPY FROM performance improvements
Date
Msg-id 200507212154.j6LLsdjA002847@smtp.osdl.org
Whole thread Raw
In response to Re: COPY FROM performance improvements  ("Luke Lonergan" <llonergan@greenplum.com>)
Responses Re: COPY FROM performance improvements  ("Luke Lonergan" <llonergan@greenplum.com>)
List pgsql-patches
I just ran through a few tests with the v14 patch against 100GB of data
from dbt3 and found a 30% improvement; 3.6 hours vs 5.3 hours.  Just to
give a few details, I only loaded data and started a COPY in parallel
for each the data files:
    http://www.testing.osdl.org/projects/dbt3testing/results/fast_copy/

Here's a visual of my disk layout, for those familiar with the database schema:
    http://www.testing.osdl.org/projects/dbt3testing/results/fast_copy/layout-dev4-010-dbt3.html

I have 6 arrays of fourteen 15k rpm drives in a split-bus configuration
attached to a 4-way itanium2 via 6 compaq smartarray pci-x controllers.

Let me know if you have any questions.

Mark

pgsql-patches by date:

Previous
From: Andrew Dunstan
Date:
Subject: Re: Roles - SET ROLE Updated
Next
From: "Luke Lonergan"
Date:
Subject: Re: COPY FROM performance improvements