Re: pg_dump custom format and pigz - Mailing list pgsql-admin

From Tino Schwarze
Subject Re: pg_dump custom format and pigz
Date
Msg-id 20091023142525.GB3252@easy2.in-chemnitz.de
Whole thread Raw
In response to Re: pg_dump custom format and pigz  ("Marc Mamin" <M.Mamin@intershop.de>)
Responses Re: pg_dump custom format and pigz
List pgsql-admin
Hi Marc,

On Fri, Oct 23, 2009 at 03:52:16PM +0200, Marc Mamin wrote:

> > You might add pigz as a post-processing step and disabling compression in pg_dump.
>
> The problem with this solution is that it make it necessary to
> decompress the dump entirely before using pg_restore (or did I miss a
> point ?)
> This is an issue as our uncompressed dumps may reach 3-500 GB...

Right, that would not work.

> A better way would be to have a configuration option to tell which
> compression tool should be used internally by pg_dump.

Well, that would mean linking pg_dump with the library providing the
compression you want. I suppose, only data is compressed, not the whole
dump, e.g. dumping without compression then compressing is different
from dumping with compression.

Tino.

--
"What we nourish flourishes." - "Was wir nähren erblüht."

www.lichtkreis-chemnitz.de
www.tisc.de

pgsql-admin by date:

Previous
From: "Marc Mamin"
Date:
Subject: Re: pg_dump custom format and pigz
Next
From: Lewis Kapell
Date:
Subject: Re: Increasing the length of a VARCHAR column without table rewrite