Re: AIO / read stream heuristics adjustments for index prefetching - Mailing list pgsql-hackers

From Melanie Plageman
Subject Re: AIO / read stream heuristics adjustments for index prefetching
Date
Msg-id CAAKRu_bWPO-w3arE3pM5i5LArp7mA+Rg0chm-1WL-JxvDxv7Cg@mail.gmail.com
Whole thread
In response to Re: AIO / read stream heuristics adjustments for index prefetching  (Andres Freund <andres@anarazel.de>)
Responses Re: AIO / read stream heuristics adjustments for index prefetching
List pgsql-hackers
On Thu, Apr 2, 2026 at 9:33 AM Andres Freund <andres@anarazel.de> wrote:
>
> > +                /*
> > +                 * XXX: Should we actually reduce this at any time other than
> > +                 * a reset? For now we have to, as this is also a condition
> > +                 * for re-enabling fast_path.
> > +                 */
> > +                if (stream->combine_distance > 1)
> > +                    stream->combine_distance--;
> >
> > I don't think we need to reduce this other than reset.
>
> Hm. I go back and forth on that one :)

Separate from the fast-path enablement, we also probably want to
decrease combine distance when we decrease readahead_distance because
there is a point where we still want to parallelize the IOs even when
the distance is lower and to do that, we need to make smaller IOs. I'm
not sure where this point is, but I wonder if a few 256kB IOs is
faster than 1 1MB IO (could test that with fio actually). I imagine
that there is some size where that is true because of peculiarities in
how drives (and cloud storage) issue/break up IOs after they are a
certain size, etc.

- Melanie



pgsql-hackers by date:

Previous
From: Haibo Yan
Date:
Subject: Re: Extract numeric filed in JSONB more effectively
Next
From: Nathan Bossart
Date:
Subject: Re: Add pg_stat_autovacuum_priority