Re: archive_command too slow. - Mailing list pgsql-performance

From Claudio Freire
Subject Re: archive_command too slow.
Date
Msg-id CAGTBQpY-TS2GM1FnfAQUdHvvK86a1a-Ntw6s83w3OU2Fwu-=yA@mail.gmail.com
Whole thread Raw
In response to Re: archive_command too slow.  (Jeff Janes <jeff.janes@gmail.com>)
List pgsql-performance
On Fri, Nov 4, 2016 at 1:19 PM, Jeff Janes <jeff.janes@gmail.com> wrote:
> If setting up the ssh tunnel is the problem, you could assess whether you
> really need that security, or compile a custom postgresql with larger WAL
> file sizes, or write a fancy archive_command which first archives the files
> to a local directory, and then transfers them in chunks to the slave.  Or
> maybe use streaming rather than file shipping.

Another option is to use ssh's ControlMaster and ControlPersist
features to keep the SSH tunnel alive between commands.

You'd have to set up the RSYNC_CONNECT_PROG environment variable on
your archive command for that and include the relevant options for ssh
in the command.


pgsql-performance by date:

Previous
From: Jeff Janes
Date:
Subject: Re: archive_command too slow.
Next
From: Justin Pryzby
Date:
Subject: Re: no MCV list of tiny table with unique columns