pgsql: Add pg_buffercache_numa view with NUMA node info - Mailing list pgsql-committers

From Tomas Vondra
Subject pgsql: Add pg_buffercache_numa view with NUMA node info
Date
Msg-id E1u1tr8-003BbP-2J@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
Add pg_buffercache_numa view with NUMA node info

Introduces a new view pg_buffercache_numa, showing NUMA memory nodes
for individual buffers. For each buffer the view returns an entry for
each memory page, with the associated NUMA node.

The database blocks and OS memory pages may have different size - the
default block size is 8KB, while the memory page is 4K (on x86). But
other combinations are possible, depending on configure parameters,
platform, etc. This means buffers may overlap with multiple memory
pages, each associated with a different NUMA node.

To determine the NUMA node for a buffer, we first need to touch the
memory pages using pg_numa_touch_mem_if_required, otherwise we might get
status -2 (ENOENT = The page is not present), indicating the page is
either unmapped or unallocated.

The view may be relatively expensive, especially when accessed for the
first time in a backend, as it touches all memory pages to get reliable
information about the NUMA node. This may also force allocation of the
shared memory.

Author: Jakub Wartak <jakub.wartak@enterprisedb.com>
Reviewed-by: Andres Freund <andres@anarazel.de>
Reviewed-by: Bertrand Drouvot <bertranddrouvot.pg@gmail.com>
Reviewed-by: Tomas Vondra <tomas@vondra.me>
Discussion: https://postgr.es/m/CAKZiRmxh6KWo0aqRqvmcoaX2jUxZYb4kGp3N%3Dq1w%2BDiH-696Xw%40mail.gmail.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/ba2a3c2302f1248496322eba917b17a421499388

Modified Files
--------------
contrib/pg_buffercache/Makefile                    |   5 +-
.../expected/pg_buffercache_numa.out               |  29 +++
.../expected/pg_buffercache_numa_1.out             |   3 +
contrib/pg_buffercache/meson.build                 |   2 +
.../pg_buffercache/pg_buffercache--1.5--1.6.sql    |  22 ++
contrib/pg_buffercache/pg_buffercache.control      |   2 +-
contrib/pg_buffercache/pg_buffercache_pages.c      | 285 +++++++++++++++++++++
contrib/pg_buffercache/sql/pg_buffercache_numa.sql |  21 ++
doc/src/sgml/pgbuffercache.sgml                    |  85 +++++-
src/tools/pgindent/typedefs.list                   |   2 +
10 files changed, 452 insertions(+), 4 deletions(-)


pgsql-committers by date:

Previous
From: Álvaro Herrera
Date:
Subject: pgsql: Use specific collation where needed in new test
Next
From: Michael Paquier
Date:
Subject: pgsql: Flush the IO statistics of active WAL senders more frequently