Re: pg_dump of database with numerous objects - Mailing list pgsql-general

From Alvaro Herrera
Subject Re: pg_dump of database with numerous objects
Date
Msg-id 20200603201055.GA30037@alvherre.pgsql
Whole thread Raw
In response to pg_dump of database with numerous objects  (tony@exquisiteimages.com)
Responses Re: pg_dump of database with numerous objects  (Bruce Momjian <bruce@momjian.us>)
List pgsql-general
On 2020-May-31, tony@exquisiteimages.com wrote:

> I am now needing to upgrade to a new version of PostgreSQL and I am running
> into problems when pg_upgrade calls pg_dump. pg_dump stalled at: "pg_dump:
> saving database definition" for 24 hours before I killed the process.
> 
> My pg_class table contains 9,000,000 entries and I have 9004 schema.

We've made a number of performance improvements to pg_dump so that it
can dump databases that are "large" in several different dimensions, but
evidently from your report it is not yet good enough when it comes to
dumping millions of tables in thousands of schemas.  It will probably
take some profiling of pg_dump to figure out where the bottleneck is,
and some careful optimization work in order to make it faster.  Not a
weekend job, I'm afraid :-(

-- 
Álvaro Herrera                https://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services



pgsql-general by date:

Previous
From: Rob Sargent
Date:
Subject: Re: Can we get SQL Server-like cross database queries
Next
From: Adrian Klaver
Date:
Subject: Re: Fine grained permissions on User Mapping