Re: Read-ahead and parallelism in redo recovery - Mailing list pgsql-hackers

From Florian G. Pflug
Subject Re: Read-ahead and parallelism in redo recovery
Date
Msg-id 47C8AB29.6000400@phlo.org
Whole thread Raw
In response to Read-ahead and parallelism in redo recovery  ("Pavan Deolasee" <pavan.deolasee@gmail.com>)
Responses Re: Read-ahead and parallelism in redo recovery
List pgsql-hackers
Greg Stark wrote:
> Florian G. Pflug wrote:
>> The same holds true for index scans, though. Maybe we can find a 
>> solution that benefits both cases - something along the line of a 
>> bgreader process
> I posted a patch to do readahead for bitmap index scans using 
> posix_fadvise. Experiments showed it works great on raid arrays on 
> Linux. Solaris will need to use libaio though which I haven't tried 
> yet.
Cool! I'd like to try it out - is that patch available in the pg-patches
archives?

> Doing it for normal index scans is much much harder. You can 
> readahead a single page by using the next pointer if it looks like 
> you'll need it. But I don't see a convenient way to get more than 
> that.
I was thinking that after reading a page from the index, the backend
could post a list of heap pages referenced from that index page to the
shmem. A background process would repeatedly scan that list, and load
those pages into the buffer cache.

regards, Florian Pflug




pgsql-hackers by date:

Previous
From: Gregory Stark
Date:
Subject: Re: Read-ahead and parallelism in redo recovery
Next
From: "Hiroshi Saito"
Date:
Subject: Re: OSSP can be used in the windows environment now!