pgsql: Collect statistics about SLRU caches - Mailing list pgsql-committers

From Tomas Vondra
Subject pgsql: Collect statistics about SLRU caches
Date
Msg-id E1jJntl-0006Mv-PD@gemulon.postgresql.org
Whole thread Raw
Responses Re: pgsql: Collect statistics about SLRU caches  (Thomas Munro <thomas.munro@gmail.com>)
List pgsql-committers
Collect statistics about SLRU caches

There's a number of SLRU caches used to access important data like clog,
commit timestamps, multixact, asynchronous notifications, etc. Until now
we had no easy way to monitor these shared caches, compute hit ratios,
number of reads/writes etc.

This commit extends the statistics collector to track this information
for a predefined list of SLRUs, and also introduces a new system view
pg_stat_slru displaying the data.

The list of built-in SLRUs is fixed, but additional SLRUs may be defined
in extensions. Unfortunately, there's no suitable registry of SLRUs, so
this patch simply defines a fixed list of SLRUs with entries for the
built-in ones and one entry for all additional SLRUs. Extensions adding
their own SLRU are fairly rare, so this seems acceptable.

This patch only allows monitoring of SLRUs, not tuning. The SLRU sizes
are still fixed (hard-coded in the code) and it's not entirely clear
which of the SLRUs might need a GUC to tune size. In a way, allowing us
to determine that is one of the goals of this patch.

Bump catversion as the patch introduces new functions and system view.

Author: Tomas Vondra
Reviewed-by: Alvaro Herrera
Discussion: https://www.postgresql.org/message-id/flat/20200119143707.gyinppnigokesjok@development

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/28cac71bd368788d1ab22f048eef211641fb1283

Modified Files
--------------
doc/src/sgml/monitoring.sgml         |  97 ++++++++++++
src/backend/access/transam/slru.c    |  23 +++
src/backend/catalog/system_views.sql |  14 ++
src/backend/postmaster/pgstat.c      | 297 +++++++++++++++++++++++++++++++++++
src/backend/utils/adt/pgstatfuncs.c  |  91 +++++++++++
src/include/catalog/catversion.h     |   2 +-
src/include/catalog/pg_proc.dat      |  15 ++
src/include/pgstat.h                 |  65 ++++++++
src/test/regress/expected/rules.out  |  10 ++
9 files changed, 613 insertions(+), 1 deletion(-)


pgsql-committers by date:

Previous
From: Tom Lane
Date:
Subject: pgsql: Clean up parsing of ltree and lquery some more.
Next
From: Amit Kapila
Date:
Subject: Re: pgsql: Allow vacuum command to process indexes in parallel.