Optimize planner memory consumption for huge arrays - Mailing list pgsql-hackers

From Lepikhov Andrei
Subject Optimize planner memory consumption for huge arrays
Date
Msg-id em9939439a-441a-4b27-a977-ebdf5987dc49@7d14f008.com
Whole thread Raw
Responses Re: Optimize planner memory consumption for huge arrays
Re: Optimize planner memory consumption for huge arrays
List pgsql-hackers
Hi, hackers,

Looking at the planner behaviour with the memory consumption patch [1], I figured out that arrays increase memory
consumptionby the optimizer significantly. See init.sql in attachment.
 
The point here is that the planner does small memory allocations for each element during estimation. As a result, it
lookslike the planner consumes about 250 bytes for each integer element.
 

It is maybe not a problem most of the time. However, in the case of partitions, memory consumption multiplies by each
partition.Such a corner case looks weird, but the fix is simple. So, why not?
 

The diff in the attachment is proof of concept showing how to reduce wasting of memory. Having benchmarked a bit, I
didn'tfind any overhead.
 

[1] Report planning memory in EXPLAIN ANALYZE
https://www.postgresql.org/message-id/flat/CAExHW5sZA=5LJ_ZPpRO-w09ck8z9p7eaYAqq3Ks9GDfhrxeWBw@mail.gmail.com

--
Regards,
Andrey Lepikhov

Attachment

pgsql-hackers by date:

Previous
From: Dilip Kumar
Date:
Subject: Re: Impact of checkpointer during pg_upgrade
Next
From: Amit Kapila
Date:
Subject: Re: Impact of checkpointer during pg_upgrade