Re: Warn when parallel restoring a custom dump without data offsets - Mailing list pgsql-hackers

From Tom Lane
Subject Re: Warn when parallel restoring a custom dump without data offsets
Date
Msg-id 25161.1589986110@sss.pgh.pa.us
Whole thread Raw
In response to Re: Warn when parallel restoring a custom dump without data offsets  (David Gilman <davidgilman1@gmail.com>)
Responses Re: Warn when parallel restoring a custom dump without data offsets  (David Gilman <davidgilman1@gmail.com>)
List pgsql-hackers
David Gilman <davidgilman1@gmail.com> writes:
>> I think the PG11
>> commit you mentioned (548e5097) happens to make some databases fail in
>> parallel restore that previously worked (I didn't check).

> Correct, if you do the bisect around that yourself you'll see
> pg_restore start failing with the expected "possibly due to
> out-of-order restore request" on offset-less dumps.

Yeah.  Now, the whole point of that patch was to decouple the restore
order from the dump order ... but with an offset-less dump file, we
can't do that, or at least the restore order is greatly constrained.
I wonder if it'd be sensible for pg_restore to use a different parallel
scheduling algorithm if it notices that the input lacks offsets.
(There could still be some benefit from parallelism, just not as much.)
No idea if this is going to be worth the trouble, but it probably
is worth looking into.

            regards, tom lane



pgsql-hackers by date:

Previous
From: Tom Lane
Date:
Subject: Re: Extensions not dumped when --schema is used
Next
From: Robert Haas
Date:
Subject: Re: factorial function/phase out postfix operators?