RE: pg_basebackup inconsistent performance - Mailing list pgsql-general

From Jasen Lentz
Subject RE: pg_basebackup inconsistent performance
Date
Msg-id MN2PR13MB403962F8B2DAB161098093C7BCA50@MN2PR13MB4039.namprd13.prod.outlook.com
Whole thread Raw
In response to Re: pg_basebackup inconsistent performance  (Stephen Frost <sfrost@snowman.net>)
List pgsql-general
Is the backup server shared among other systems..?
No,  physical system

And there's no increased activity on the backup server either?
No

Have you looked at network traffic for the duration?  And/or disk i/o on each system?  If you ran a backup once and
thenimmediately after and that's the 'fast' case then you may be seeing performance be better due to a lot of data
beingin the filesystem cache.  pg_basebackup being single-threaded probably doesn't help here either, you might want to
considerone of the parallel-backup options. 

Yes, looked at all the system stats, nothing changed, just the backups running extremely long.

Was looking into pgbackrest, just haven't gotten it configured yet


-----Original Message-----
From: Stephen Frost <sfrost@snowman.net>
Sent: Wednesday, May 6, 2020 12:30 PM
To: Jasen Lentz <jlentz@sescollc.com>
Cc: Adrian Klaver <adrian.klaver@aklaver.com>; pgsql-general@lists.postgresql.org
Subject: Re: pg_basebackup inconsistent performance

Greetings,

* Jasen Lentz (jlentz@sescollc.com) wrote:
> Where are the machines you are backing up from/to relative to each on the network?
> Direct ethernet connection between 10G network interfaces

Is the backup server shared among other systems..?

> Is there increased activity on the database servers e.g. inserts, updates, etc during the extended backups?
> Not according to sar reports

And there's no increased activity on the backup server either?

Have you looked at network traffic for the duration?  And/or disk i/o on each system?  If you ran a backup once and
thenimmediately after and that's the 'fast' case then you may be seeing performance be better due to a lot of data
beingin the filesystem cache.  pg_basebackup being single-threaded probably doesn't help here either, you might want to
considerone of the parallel-backup options. 

Thanks,

Stephen



pgsql-general by date:

Previous
From: Lisandro Rostagno
Date:
Subject: Could not launch new process for connection: Could not allocate memory
Next
From: "Ashish Chugh"
Date:
Subject: RE: Abnormal Growth of Index Size - Index Size 3x large than tablesize.