Re: Improving executor performance - Mailing list pgsql-hackers

From Andres Freund
Subject Re: Improving executor performance
Date
Msg-id 20160629183254.frcm3dgg54ud5m6o@alap3.anarazel.de
Whole thread Raw
In response to Re: Improving executor performance  (Rajeev rastogi <rajeev.rastogi@huawei.com>)
Responses Re: Improving executor performance  (Craig Ringer <craig@2ndquadrant.com>)
List pgsql-hackers
Hi,

On 2016-06-28 10:01:28 +0000, Rajeev rastogi wrote:
> >3) Our 1-by-1 tuple flow in the executor has two major issues:
> 
> Agreed, In order to tackle this IMHO, we should
> 1. Makes the processing data-centric instead of operator centric.
> 2. Instead of pulling each tuple from immediate operator, operator can push the tuple to its parent. It can be
allowedto push until it sees any operator, which cannot be processed without result from other operator.   
 
> More details from another thread:
> https://www.postgresql.org/message-id/BF2827DCCE55594C8D7A8F7FFD3AB77159A9B904@szxeml521-mbs.china.huawei.com 

I doubt that that's going to be ok in the generic case (memory usage,
materializing too much, "bushy plans", merge joins), and it's way more
invasive than what I'm thinking of.  I think by having batches of tuples
"bubble" up in a vulcano style executor, it's possible to get most of
the improvements of both approaches.

Andres



pgsql-hackers by date:

Previous
From: Alvaro Herrera
Date:
Subject: Re: primary_conninfo missing from pg_stat_wal_receiver
Next
From: Alvaro Herrera
Date:
Subject: Re: An unkillable connection caused replication delay on my replica