Re: plan with result cache is very slow when work_mem is not enough - Mailing list pgsql-hackers

From Yura Sokolov
Subject Re: plan with result cache is very slow when work_mem is not enough
Date
Msg-id fb424f12f1b3d37cdba7c8167ec8e58e@postgrespro.ru
Whole thread Raw
In response to Re: plan with result cache is very slow when work_mem is not enough  (Pavel Stehule <pavel.stehule@gmail.com>)
Responses Re: plan with result cache is very slow when work_mem is not enough
Re: plan with result cache is very slow when work_mem is not enough
List pgsql-hackers
Pavel Stehule писал 2021-05-07 21:45:
>> 
>> Samples: 119K of event 'cycles', 4000 Hz, Event count (approx.):
>> Overhead  Shared Object             Symbol
>> 79.20%  postgres                  [.] cache_reduce_memory
>> 1.94%  [kernel]                  [k] native_write_msr_safe
>> 1.63%  [kernel]                  [k] update_cfs_shares
>> 1.00%  [kernel]                  [k] trigger_load_balance
>> 0.97%  [kernel]                  [k] timerqueue_add
>> 0.51%  [kernel]                  [k] task_tick_fair
>> 0.51%  [kernel]                  [k] task_cputime
>> 0.50%  [kernel]                  [k] perf_event_task_tick
>> 0.50%  [kernel]                  [k] update_curr
>> 0.49%  [kernel]                  [k] hrtimer_active
>> 
>> Regards
>> 
>> Pavel

It is strange to see cache_reduce_memory itself consumes a lot of CPU.
It doesn't contain CPU hungry code.
It calls prepare_probe_slot, that calls some tuple forming. Then
it calls resultcache_lookup that may call to ResultCacheHash_hash
and ResultCacheHash_equal. And finally it calls remove_cache_entry.
I suppose remove_cache_entry should consume most of CPU time since
it does deallocations.
And if you compile with --enable-cassert, then remove_cache_entry
iterates through whole cache hashtable, therefore it reaches
quadratic complexity easily (or more correct M*N, where M - size
of a table, N - eviction count).

regards,
Yura Sokolov



pgsql-hackers by date:

Previous
From: Pavel Stehule
Date:
Subject: Re: plan with result cache is very slow when work_mem is not enough
Next
From: Tomas Vondra
Date:
Subject: Re: plan with result cache is very slow when work_mem is not enough