Performance of COPY for Archive operations - Mailing list pgsql-hackers-win32

From Simon Riggs
Subject Performance of COPY for Archive operations
Date
Msg-id NOEFLCFHBPDAFHEIPGBOCEIACEAA.simon@2ndquadrant.com
Whole thread Raw
Responses Re: Performance of COPY for Archive operations  (Bruce Momjian <pgman@candle.pha.pa.us>)
List pgsql-hackers-win32
I've spent a while working with PITR functionality on the Win32 port.

I noticed that *it works*, which is always great, but using a COPY command
the archival operation was significantly slower than the writing of the
xlogs themselves.

At one point, I got to being more than 10 xlog files behind with the list
growing steadily, and took a while to clear the logjam when my test
workloads completed. Not much point having archiving thats actually slower
than the writing of xlog....

IIRC the COPY command isn't the best thing to use for bulk-copying on
Windows, but I can't remember what is better. Anybody?

My tests were conducted on a small test server, but the imbalance between
xlog write/copy is worrying. I have 1 Gb RAM, which was nowhere near full
during testing. CPU was extremely low, so I'm guessing COPY has some bad I/O
characteristics.

Of course, I don't expect to be using COPY in production much...but others
will, so I want to sort this out. Feel free to point out the obvious....if
it exists,

Best regards,

Simon Riggs



pgsql-hackers-win32 by date:

Previous
From: "Magnus Hagander"
Date:
Subject: plpython
Next
From: Bruce Momjian
Date:
Subject: Re: Performance of COPY for Archive operations