Re: performance of pg_upgrade "Copying user relation files" - Mailing list pgsql-general

From Adrian Klaver
Subject Re: performance of pg_upgrade "Copying user relation files"
Date
Msg-id a501a04b-e5a1-174c-cf71-35271c783e2c@aklaver.com
Whole thread Raw
In response to performance of pg_upgrade "Copying user relation files"  (Glenn Pierce <glennpierce@gmail.com>)
List pgsql-general
On 10/2/19 3:30 PM, Glenn Pierce wrote:
> I have been trying to upgrade postgres 9.5 to 9.6 with pg_upgrade
> 
> Everything seems to start fine but when pg_upgrade gets to "Copying
> user relation files"
> It takes ages to complete copying.

Adding to previous list:

4) Which pg_upgrade version did you use, 9.5 or 9.6?

> 
> ie
> Each file like
> 
> /var/lib/pgsql/9.5/data/base/24602/25140
> is 1G and taking ~5-10 minutes to copyand that directory is 223G of
> about 990 files
> 
> After a couple of hours running pg_upgrade I had to give up.
> 
> looking a iotop I was seeing
> 
> 99% IO load caused by [md0_raid1]
> 
> and only seeing pg_upgrade go to 99% every 3-4 seconds
> 
> I had no other processes using io or high cpu.
> 
> Has anyone got any pointers of what could be the issue ?
> 
> Ps running cp on /var/lib/pgsql/9.5/data/base/24602/25140 to my home
> directory is instantaneous
> 
> System is Centos 7
> 
> Thanks
> 
> 


-- 
Adrian Klaver
adrian.klaver@aklaver.com



pgsql-general by date:

Previous
From: Adrian Klaver
Date:
Subject: Re: performance of pg_upgrade "Copying user relation files"
Next
From: Tom Lane
Date:
Subject: Re: Wall shiping replica failed to recover database with error: invalid contrecord length 1956 at FED/38FFE208