Re: pg_dump and pg_restore with multiple streams does Not seem to improve overall times - Mailing list pgsql-admin

From Igor Neyman
Subject Re: pg_dump and pg_restore with multiple streams does Not seem to improve overall times
Date
Msg-id A76B25F2823E954C9E45E32FA49D70ECCD45210F@mail.corp.perceptron.com
Whole thread Raw
In response to Re: pg_dump and pg_restore with multiple streams does Not seem to improve overall times  (Jan Lentfer <Jan.Lentfer@web.de>)
List pgsql-admin

 

 

From: Jan Lentfer [mailto:Jan.Lentfer@web.de]
Sent: Monday, May 04, 2015 2:03 PM
To: Igor Neyman; Mel Llaguno
Cc: pgsql-admin@postgresql.org
Subject: RE: [ADMIN] pg_dump and pg_restore with multiple streams does Not seem to improve overall times

 

 

Am 4. Mai 2015 19:22:07 MESZ, schrieb Igor Neyman <ineyman@perceptron.com>:



-----Original Message-----
From: pgsql-admin-owner@postgresql.org [mailto:pgsql-admin-owner@postgresql.org] On Behalf Of Jan Lentfer
Sent: Monday, May 04, 2015 12:42 PM
To: Mel Llaguno
Cc: pgsql-admin@postgresql.org
Subject: Re: [ADMIN] pg_dump and pg_restore with multiple streams does Not seem to improve overall times

I don't know about parallel pg_dump as we use -Fc and pg_dump can't do that in parallel (afaik). For dumping I have wrapped pg_dump in a shell script to dump several databases in parallel.
But for pg_restore -j option does make a big difference, at least when you have a lot of larger tables and indexes.

Regards,

Jan


Combination of -Fc  and -j definitely works in pg_dump.  And there is nothing in the docs that states otherwise.

Regards,
Igor Neyman


Well, the manual says

You can only use this option with the directory output format because this is the only output format where multiple processes can write their data at the same time.

For the -j Option

Regards

Jan

 

 

Sorry, was talking (for some reason?) about parallel restore, which was available long before parallel dump.

 

Igor Neyman

 

pgsql-admin by date:

Previous
From: Jan Lentfer
Date:
Subject: Re: pg_dump and pg_restore with multiple streams does Not seem to improve overall times
Next
From: Harshad Adalkonda
Date:
Subject: Re: Re: How do I install/run PostgreSQL 9.4 64 bit on Windows 7 Professional?