Re: WIP patch for parallel pg_dump - Mailing list pgsql-hackers

From Joachim Wieland
Subject Re: WIP patch for parallel pg_dump
Date
Msg-id AANLkTikQpktCDi6vPZtXz1Pv2uSxRoBn6wJ0Y_MVPeDD@mail.gmail.com
Whole thread Raw
In response to WIP patch for parallel pg_dump  (Joachim Wieland <joe@mcknight.de>)
Responses Re: WIP patch for parallel pg_dump  (Heikki Linnakangas <heikki.linnakangas@enterprisedb.com>)
List pgsql-hackers
On Sun, Nov 14, 2010 at 6:52 PM, Joachim Wieland <joe@mcknight.de> wrote:
> You would add a regular parallel dump with
>
> $ pg_dump -j 4 -Fd -f out.dir dbname

So this is an updated series of patches for my parallel pg_dump WIP
patch. Most importantly it now runs on Windows once you get it to
compile there (I have added the new files to the respective project of
Mkvcbuild.pm but I wondered why the other archive formats do not need
to be defined in that file...).

So far nobody has volunteered to review this patch. It would be great
if people could at least check it out, run it and let me know if it
works and if they have any comments.

I have put all four patches in a tar archive, the patches must be
applied sequentially:

1. pg_dump_compression-refactor.diff
2. pg_dump_directory.diff
3. pg_dump_directory_parallel.diff
4. pg_dump_directory_parallel_lzf.diff

The compression-refactor patch does not include Heikki's latest changes yet.

And the last of the four patches adds LZF compression for whoever
wants to try that out. You need to link against an already installed
liblzf and call it with --compress-lzf.


Joachim

Attachment

pgsql-hackers by date:

Previous
From: Jeff Davis
Date:
Subject: Re: build problem
Next
From: Heikki Linnakangas
Date:
Subject: Re: Spread checkpoint sync