RE: Protect syscache from bloating with negative cache entries - Mailing list pgsql-hackers

From Tsunakawa, Takayuki
Subject RE: Protect syscache from bloating with negative cache entries
Date
Msg-id 0A3221C70F24FB45833433255569204D1FB99888@G01JPEXMBYT05
Whole thread Raw
In response to Re: Protect syscache from bloating with negative cache entries  (Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>)
Responses RE: Protect syscache from bloating with negative cache entries  ("Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>)
List pgsql-hackers
From: Kyotaro HORIGUCHI [mailto:horiguchi.kyotaro@lab.ntt.co.jp]
> It is too complex as I was afraid. The indirect calls causes siginicant
> degradation. (Anyway the previous code was bogus in that it passes
> CACHELINEALIGN'ed pointer to get_chunk_size..)
> 
> Instead, I added an accounting(?) interface function.
> 
> | MemoryContextGettConsumption(MemoryContext cxt);
> 
> The API returns the current consumption in this memory context. This allows
> "real" memory accounting almost without overhead.

That looks like a great idea!  Actually, I was thinking of using MemoryContextStats() or its new lightweight variant to
getthe used amount, but I was afraid it would be too costly to call in catcache code.  You are smarter, and I was just
stupid.


> (2) Another new patch v15-0005 on top of previous design of
>   limit-by-number-of-a-cache feature converts it to
>   limit-by-size-on-all-caches feature, which I think is
>   Tsunakawa-san wanted.

Thank you very, very much!  I look forward to reviewing v15.  I'll be away from the office tomorrow, so I'd like to
reviewit on this weekend or the beginning of next week.  I've confirmed and am sure that 0001 can be committed.
 




> As far as I can see no significant degradation is found in usual (as long
> as pruning doesn't happen) code paths.
> 
> About the new global-size based evicition(2), cache entry creation becomes
> slow after the total size reached to the limit since every one new entry
> evicts one or more old (=
> not-recently-used) entries. Because of not needing knbos for each cache,
> it become far realistic. So I added documentation of
> "catalog_cache_max_size" in 0005.

Could you show us the comparison of before and after the pruning starts, if you already have it?  If you lost the data,
I'mOK to see the data after the code review.
 


Regards
Takayuki Tsunakawa




pgsql-hackers by date:

Previous
From: Peter Geoghegan
Date:
Subject: Re: WAL insert delay settings
Next
From: Noah Misch
Date:
Subject: Re: Spurious "apparent wraparound" via SimpleLruTruncate() rounding