Re: Performance of COPY for Archive operations - Mailing list pgsql-hackers-win32

From Bruce Momjian
Subject Re: Performance of COPY for Archive operations
Date
Msg-id 200409151355.i8FDtAX11579@candle.pha.pa.us
Whole thread Raw
In response to Performance of COPY for Archive operations  ("Simon Riggs" <simon@2ndquadrant.com>)
Responses Re: Performance of COPY for Archive operations
List pgsql-hackers-win32
Simon Riggs wrote:
>
> I've spent a while working with PITR functionality on the Win32 port.
>
> I noticed that *it works*, which is always great, but using a COPY command
> the archival operation was significantly slower than the writing of the
> xlogs themselves.
>
> At one point, I got to being more than 10 xlog files behind with the list
> growing steadily, and took a while to clear the logjam when my test
> workloads completed. Not much point having archiving thats actually slower
> than the writing of xlog....

Why was it slow?  'cp' was slower than the WAL writes?  Seems strange to
me.   Do we have some sleep loop in there that is causing us to read
that directory too slowly?  I didn't think so.

> IIRC the COPY command isn't the best thing to use for bulk-copying on
> Windows, but I can't remember what is better. Anybody?

COPY is the fastest way to get data in and out of PostgreSQL.

--
  Bruce Momjian                        |  http://candle.pha.pa.us
  pgman@candle.pha.pa.us               |  (610) 359-1001
  +  If your life is a hard drive,     |  13 Roberts Road
  +  Christ can be your backup.        |  Newtown Square, Pennsylvania 19073

pgsql-hackers-win32 by date:

Previous
From: "Simon Riggs"
Date:
Subject: Performance of COPY for Archive operations
Next
From: "Simon Riggs"
Date:
Subject: Re: Performance of COPY for Archive operations