Re: Improving pg_dump performance when handling large numbers of LOBs - Mailing list pgsql-general

From Shaheed Haque
Subject Re: Improving pg_dump performance when handling large numbers of LOBs
Date
Msg-id CAHAc2jdGFMGnhtuZWP2bqv06trjA1RpUcjFBqFZ9S+Wpk9q7CA@mail.gmail.com
Whole thread Raw
In response to Re: Improving pg_dump performance when handling large numbers of LOBs  (Ron Johnson <ronljohnsonjr@gmail.com>)
List pgsql-general
Might it be worth a modest amount of time using some basic profiling to see where the time is going? A week is a looonnngg time, even for 150e6 operations. For example, if there an unexpectedly high IO load, some temporary M.2 storage might help? 

On Tue, 6 Feb 2024, 01:36 Ron Johnson, <ronljohnsonjr@gmail.com> wrote:
On Mon, Feb 5, 2024 at 2:01 PM Wyatt Tellis <wyatt.tellis@gmail.com> wrote:
Hi,

We've inherited a series of legacy PG 12 clusters that each contain a database that we need to migrate to a PG 15 cluster. Each database contains about 150 million large objects totaling about 250GB.

250*10^9 / (150*10^6) = 1667 bytes.  That's tiny.

Am I misunderstanding you?

pgsql-general by date:

Previous
From: veem v
Date:
Subject: Re: How to do faster DML
Next
From: Fabrice Chapuis
Date:
Subject: Problem managing slots in Patroni