Re: How best to do parallel query given tens of thousands of iteration of a loop of recursive queries? - Mailing list pgsql-sql

From David G. Johnston
Subject Re: How best to do parallel query given tens of thousands of iteration of a loop of recursive queries?
Date
Msg-id CAKFQuwYsSUU1USBTzBjyNFUTzgGbLqoxZyT7o2hhuYFcyfR2CA@mail.gmail.com
Whole thread Raw
In response to How best to do parallel query given tens of thousands of iteration of a loop of recursive queries?  (Shaozhong SHI <shishaozhong@gmail.com>)
List pgsql-sql
On Sun, Apr 10, 2022 at 6:50 AM Shaozhong SHI <shishaozhong@gmail.com> wrote:
There is a plpgsql script that have a loop to carry out the same recursive queries.

The estimation of iteration is in the order of tens of thousands.

What is the best way of making using parallel query strategy.

An example would be helpful.

However, as a general guideline, since parallelism is done at the per-row scope, removing looping logic from the script and turning the main script logic into one or more functions that operate on a single row, while obeying the rules such functions need to abide by in order to be marked parallel safe, will open up the possibility for the server to process different rows using different workers and then appending their results together for the next node to consume.

David J.

pgsql-sql by date:

Previous
From: Steve Midgley
Date:
Subject: Re: How best to do parallel query given tens of thousands of iteration of a loop of recursive queries?
Next
From: "Voillequin, Jean-Marc"
Date:
Subject: enable/disable instead of trigger