Postgres Pro
Downloads
Home   >   mailing lists

Using threads in FDW for read-ahead - Mailing list pgsql-interfaces

From Noah Watkins
Subject Using threads in FDW for read-ahead
Date
Msg-id CAB2gnbUqOGZi4u8ohKGqFdvtqEz4F6LE5kedHRKJBHO7z3YdcA@mail.gmail.com
Whole thread Raw
Responses Re: Using threads in FDW for read-ahead  (Tom Lane <tgl@sss.pgh.pa.us>)
Re: Using threads in FDW for read-ahead  (Ian Pye <ianpye@gmail.com>)
List pgsql-interfaces
Tree view
I have created a FDW for a storage backend and it is working well, and now I would like to overlap processing with I/O by performing read-ahead. I started by using a thread to do background I/O and this worked, but problems started to arise when I tried to do predicate filtering in the thread.

In particular, it seems as though `check_stack_depth` is built to assume a single threaded environment (`stack_base_ptr` is global).

I'm wondering if there is a solution to this problem, or if there are examples of overlapping tuple I/O and predicate filtering using non-multithreading techniques?

Thanks,
Noah

pgsql-interfaces by date:

Previous
From: Greg Sabino Mullane
Date:
Subject: DBD::Pg 3.3.0 released (driver for Postgres)
Next
From: Tom Lane
Date:
Subject: Re: Using threads in FDW for read-ahead