[COMMITTERS] pgsql: Reduce memory usage of targetlist SRFs. - Mailing list pgsql-committers

From Andres Freund
Subject [COMMITTERS] pgsql: Reduce memory usage of targetlist SRFs.
Date
Msg-id E1e1Jlc-0002ta-NP@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
Reduce memory usage of targetlist SRFs.

Previously nodeProjectSet only released memory once per input tuple,
rather than once per returned tuple. If the computation of an
individual returned tuple requires a lot of memory, that can lead to
problems.

Instead change things so that the expression context can be reset once
per output tuple, which requires a new memory context to store SRF
arguments in.

This is a longstanding issue, but was hard to fix before 9.6, due to
the way tSRFs where evaluated. But it's fairly easy to fix now. We
could backpatch this into 10, but given there've been fewc omplaints
that doesn't seem worth the risk so far.

Reported-By: Lucas Fairchild
Author: Andres Freund, per discussion with Tom Lane
Discussion: https://postgr.es/m/4514.1507318623@sss.pgh.pa.us

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/84ad4b036d975ad1be0f52251bac3a06463c9811

Modified Files
--------------
src/backend/executor/execSRF.c        | 31 ++++++++++++++++++++++++++++---
src/backend/executor/nodeProjectSet.c | 32 +++++++++++++++++++++++++++-----
src/include/executor/executor.h       |  1 +
src/include/nodes/execnodes.h         |  1 +
4 files changed, 57 insertions(+), 8 deletions(-)


--
Sent via pgsql-committers mailing list (pgsql-committers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-committers

pgsql-committers by date:

Previous
From: Tom Lane
Date:
Subject: [COMMITTERS] pgsql: Increase distance between flush requests during bulk filecopies
Next
From: Peter Eisentraut
Date:
Subject: [COMMITTERS] pgsql: Remove unused documentation file