Re: Parallel heap vacuum - Mailing list pgsql-hackers

From Dilip Kumar
Subject Re: Parallel heap vacuum
Date
Msg-id CAFiTN-uqq9icbjq_2W0OE=Abqbs2uL+t0n4_uCDyGFTXKYdsrw@mail.gmail.com
Whole thread Raw
In response to Re: Parallel heap vacuum  (Amit Kapila <amit.kapila16@gmail.com>)
List pgsql-hackers
On Wed, Mar 12, 2025 at 3:40 PM Amit Kapila <amit.kapila16@gmail.com> wrote:
>
> On Wed, Mar 12, 2025 at 11:24 AM Dilip Kumar <dilipbalaut@gmail.com> wrote:
> >
> > On Wed, Mar 12, 2025 at 3:17 AM Masahiko Sawada <sawada.mshk@gmail.com> wrote:
> > >
> > > On Tue, Mar 11, 2025 at 5:51 AM Amit Kapila <amit.kapila16@gmail.com> wrote:
> > > >
> >
> > Some thoughts/questions on the idea
> >
> > I notice that we are always considering block-level parallelism for
> > heaps and object-level parallelism for indexes. I'm wondering, when
> > multiple tables are being vacuumed together—either because the user
> > has provided a list of tables or has specified a  partitioned table
> > with multiple children—does it still make sense to default to
> > block-level parallelism? Or could we consider table-level parallelism
> > in such cases? For example, if there are 4 tables and 6 workers, with
> > 2 tables being small and the other 2 being large, perhaps we could
> > allocate 4 workers to vacuum all 4 tables in parallel. For the larger
> > tables, we could apply block-level parallelism, using more workers for
> > internal parallelism. On the other hand, if all tables are small, we
> > could just apply table-level parallelism without needing block-level
> > parallelism at all. This approach could offer more flexibility, isn't
> > it?
> >
>
> I have not thought from this angle, but it seems we can build this
> even on top of block-level vacuum for large tables.

Yes, that can be built on top of block-level vacuum. In that case, we
can utilize the workers more efficiently, depending on how many
workers we have and how many tables need to be vacuumed. And yes, that
could also be discussed separately.

--
Regards,
Dilip Kumar
EnterpriseDB: http://www.enterprisedb.com



pgsql-hackers by date:

Previous
From: Amit Kapila
Date:
Subject: Re: Parallel heap vacuum
Next
From: Rushabh Lathia
Date:
Subject: Re: Support NOT VALID / VALIDATE constraint options for named NOT NULL constraints