Re: PostgreSQL Dump rate is too slow - Mailing list pgsql-admin

From ktm@rice.edu
Subject Re: PostgreSQL Dump rate is too slow
Date
Msg-id 20150108134529.GE3783@aart.rice.edu
Whole thread Raw
In response to PostgreSQL Dump rate is too slow  (girish R G peetle <giri.anamika0@gmail.com>)
List pgsql-admin
On Thu, Jan 08, 2015 at 11:05:54AM +0530, girish R G peetle wrote:
> Hi all,
> We have a customer who has 1TB database on a production server. They are
> trying dump based backup of this large database. Following dump command is
> being used.
> Dump rate is around 12 GB/hr, which will take lot of time for the backup to
> complete. This is affecting their production server.
> Is there is a way to increase dump data rate ?
>
> pg_dump -U <User> -Fc -b --port=<Port> '<Db-Name>'
>
>
> PostgreSQL version : 9.2.4
> Platform : Linux
>
> Thanks
> Girish

Hi Girish,

The custom format is compressed by default and your dump rate is hamstrung by
the slow compression algorithm being used. I our case for a smaller DB, turning
off compression completely (-Z 0) dropped our time to dump the DB from 6 hours
to about 20 minutes. You can push the uncompressed dump through a faster compression
engine using lzo, snappy or lz4 if you need to have compressed output due to space
limitations.

Regards,
Ken


pgsql-admin by date:

Previous
From: Kieran
Date:
Subject: First point release of 9.4
Next
From: Scott Ribe
Date:
Subject: Re: PostgreSQL Dump rate is too slow