Re: [PERFORM] pg_dump and thousands of schemas - Mailing list pgsql-hackers

From Tatsuo Ishii
Subject Re: [PERFORM] pg_dump and thousands of schemas
Date
Msg-id 20120531.092043.1953698679173443322.t-ishii@sraoss.co.jp
Whole thread Raw
Responses Re: [PERFORM] pg_dump and thousands of schemas
Re: [PERFORM] pg_dump and thousands of schemas
List pgsql-hackers
>> Yeah, Jeff's experiments indicated that the remaining bottleneck is lock
>> management in the server.  What I fixed so far on the pg_dump side
>> should be enough to let partial dumps run at reasonable speed even if
>> the whole database contains many tables.  But if psql is taking
>> AccessShareLock on lots of tables, there's still a problem.
>
> Ok, I modified the part of pg_dump where tremendous number of LOCK
> TABLE are issued. I replace them with single LOCK TABLE with multiple
> tables. With 100k tables LOCK statements took 13 minutes in total, now
> it only takes 3 seconds. Comments?

Shall I commit to master and all supported branches?
--
Tatsuo Ishii
SRA OSS, Inc. Japan
English: http://www.sraoss.co.jp/index_en.php
Japanese: http://www.sraoss.co.jp

pgsql-hackers by date:

Previous
From: Jeff Janes
Date:
Subject: Re: Figuring out shared buffer pressure
Next
From: Sergey Koposov
Date:
Subject: Re: 9.2beta1, parallel queries, ReleasePredicateLocks, CheckForSerializableConflictIn in the oprofile