Re: pg_basebackup blocking all queries with horrible performance - Mailing list pgsql-admin

From Simon Riggs
Subject Re: pg_basebackup blocking all queries with horrible performance
Date
Msg-id CA+U5nMJmuYsFD35SvjhKat0Fcd=8DiALxB8JUdY9kFvF3=bStw@mail.gmail.com
Whole thread Raw
In response to Re: pg_basebackup blocking all queries with horrible performance  (Magnus Hagander <magnus@hagander.net>)
Responses Re: pg_basebackup blocking all queries with horrible performance  (Lonni J Friedman <netllama@gmail.com>)
List pgsql-admin
On 13 June 2012 02:39, Magnus Hagander <magnus@hagander.net> wrote:

>> I'm running the following, which gets piped over ssh to a remote
>> server (at gigabit ethernet speed):
>> pg_basebackup -v -D - -x -Ft -U postgres
>>
>> One thing that I've discovered is that if I throttle back the speed of
>> what is getting piped to the remote server, that directly correlates
>> to the load on the server.
>
> That seems to indicate that you're overloading the I/O system... Or
> the CPU, but more likely I/O.

CPU utilisation of ssl connections is bad. If network bandwidth is
good, perhaps running WALSender at full speed with encryption can tank
the server.

An effect related to cacheing of WAL files? Perhaps we need to mark
them as FADV_DONTNEED at some point.

Hard to say without detailed analysis.

--
 Simon Riggs                   http://www.2ndQuadrant.com/
 PostgreSQL Development, 24x7 Support, Training & Services

pgsql-admin by date:

Previous
From: Vishwas Dwivedi
Date:
Subject: Issue in save and retreive file in postgres
Next
From: Lonni J Friedman
Date:
Subject: Re: pg_basebackup blocking all queries with horrible performance