F.52. pgpro_usage — per-user statistics on relations and functions #

The pgpro_usage extension provides per-user statistics on accessing relations and calling functions.

Note

If the server is shut down, the statistics collected by pgpro_usage are stored in the $PGDATA/pg_stat/pgpro_usage.stat file. To retain these statistics when switching to a standby, you need to manually copy this file from the former primary or restore it from a backup.

F.52.1. Installing the pgpro_usage Extension #

The pgpro_usage extension is a built-in extension included into Postgres Pro Enterprise. To enable pgpro_usage, complete the following steps:

  1. Add pgpro_usage to the shared_preload_libraries variable in the postgresql.conf file:

    shared_preload_libraries = 'pgpro_usage'
    
  2. Restart the database server for the changes to take effect. To verify that the pgpro_usage library was installed correctly, you can run the following command:

    SHOW shared_preload_libraries;
    
  3. Create the pgpro_usage extension using the following query:

    CREATE EXTENSION pgpro_usage;
    

F.52.2. Uninstalling the pgpro_usage Extension #

To properly uninstall pgpro_usage, complete the following steps:

  1. Delete the pgpro_usage extension using the following query:

    DROP EXTENSION pgpro_usage;
    

  2. Remove pgpro_usage from the shared_preload_libraries variable in the postgresql.conf file.

F.52.3. Functions #

To collect per-user statistics on accessing relations and calling functions, pgpro_usage provides an SQL interface that consists of several functions and views.

F.52.3.1. Functions to Collect Per-user Statistics on Relations #

pg_stat_get_read_req_per_user(targetoid oid, roleoid oid) → BIGINT

Returns the number of requests from a user/role specified by roleoid to read a table or index specified by targetoid.

pg_stat_get_insert_req_per_user(targetoid oid, roleoid oid) → BIGINT

Returns the number of requests from a user/role specified by roleoid to insert data in a table specified by targetoid.

pg_stat_get_update_req_per_user(targetoid oid, roleoid oid) → BIGINT

Returns the number of requests from a user/role specified by roleoid to update data in a table specified by targetoid.

pg_stat_get_delete_req_per_user(targetoid oid, roleoid oid) → BIGINT

Returns the number of requests from a user/role specified by roleoid to delete data from a table specified by targetoid.

pg_stat_get_truncate_req_per_user(targetoid oid, roleoid oid) → BIGINT

Returns the number of requests from a user/role specified by roleoid to truncate a table specified by targetoid.

pg_stat_get_grants_given_per_user(targetoid oid, roleoid oid) → BIGINT

Returns the number of GRANT and REVOKE commands executed by a user/role specified by roleoid for the table specified by the targetoid.

pg_stat_get_last_read_per_user(targetoid oid, roleoid oid) → timestamp with timezone

Returns the date and time when a user/role specified by roleoid last executed SELECT from a table specified by targetoid.

pg_stat_get_last_insert_per_user(targetoid oid, roleoid oid) → timestamp with timezone

Returns the date and time when a user/role specified by roleoid last executed INSERT into a table specified by targetoid.

pg_stat_get_last_update_per_user(targetoid oid, roleoid oid) → timestamp with timezone

Returns the date and time when a user/role specified by roleoid last executed UPDATE of a table specified by targetoid.

pg_stat_get_last_delete_per_user(targetoid oid, roleoid oid) → timestamp with timezone

Returns the date and time when a user/role specified by roleoid last executed DELETE from a table specified by targetoid.

pg_stat_get_last_truncate_per_user(targetoid oid, roleoid oid) → timestamp with timezone

Returns the date and time when a user/role specified by roleoid last executed TRUNCATE of a table specified by targetoid.

F.52.3.2. Functions to Collect Per-user Statistics on Functions #

pg_stat_get_func_calls_per_user(targetoid oid, roleoid oid) → BIGINT

Returns the number of times the function specified by targetoid has been called by the user/role specified by roleoid.

pg_stat_get_func_grants_given_per_user(targetoid oid, roleoid oid) → BIGINT

Returns the number of GRANT and REVOKE commands executed by a user/role specified by roleoid for the function specified by the targetoid.

F.52.3.3. Support Functions #

pgpro_usage_reset(full_reset bool default false) → void

Resets the pgpro_usage statistics. If full_reset is true, all the statistics gets reset. If full_reset is false, last-use statistics on tables remain intact.

pgpro_usage_get_last_reset_time() → timestamp with time zone

Time at which pgpro_usage statistics were last reset.

F.52.4. Views #

F.52.4.1. pg_stat_all_tables_per_user View #

The pg_stat_all_tables_per_user view will contain one row for each user/role and each table in the current database (including TOAST tables), showing statistics about different kinds of requests for that specific table from that user.

Table F.43. pg_stat_all_tables_per_user Columns

Column Type

Description

userid oid

OID of a user/role

username name

Name of the user/role

relid oid

OID of a table

nspname name

Name of the schema that this table is in

relname name

Name of this table

n_reads bigint

Number of requests from this user/role to read this table

n_inserts INT

Number of requests from this user/role to insert data in this table

n_updates INT

Number of requests from this user/role to update data in this table

n_deletes INT

Number of requests from this user/role to delete data from this table

n_truncates INT

Number of requests from this user/role to truncate this table

n_grants_given INT

Number of GRANT and REVOKE commands executed by this user/role for this table


F.52.4.2. pg_stat_all_tables_last_usage View #

The pg_stat_all_tables_last_usage view will contain one row for each user/role and each table in the current database (including TOAST tables), showing the last date and time when that user executed different operations on that specific table.

Table F.44. pg_stat_all_tables_last_usage Columns

Column Type

Description

userid oid

OID of a user/role

username name

Name of the user/role

nspname name

Name of the namespace

relid oid

OID of a table

relname name

Name of this table

last_read timestamp with timezone

Date and time when this user/role last read this table

last_insert timestamp with timezone

Date and time when this user/role last inserted data into this table

last_update timestamp with timezone

Date and time when this user/role last updated this table

last_delete timestamp with timezone

Date and time when this user/role last deleted data from this table

last_truncate timestamp with timezone

Date and time when this user/role last truncated this table


F.52.4.3. pg_stat_all_functions_per_user View #

The pg_stat_all_functions_per_user view will contain one row for each user/role and each user function, stored procedure, or system function in the current database, showing statistics about function calls and grants given by that user.

Table F.45. pg_stat_all_functions_per_user Columns

Column Type

Description

userid oid

OID of a user/role

username name

Name of the user/role

funcid oid

OID of a function

nspname name

Name of the schema the function is in

funcname name

Name of this function

calls INT

Number of times this function has been called by this user/role

grants_given INT

Number of GRANT and REVOKE commands executed by this user/role for this function


F.52.4.4. pgpro_usage_stats_privileges_usage View #

The pgpro_usage_stats_privileges_usage view will contain one row for each role, each privilege, and each object (table or function) for which this role has this privilege. This row will show how this privilege has been given and whether it is used.

Table F.46. pgpro_usage_stats_privileges_usage Columns

Column Type

Description

usename name

Name of a user

access text

Type of a privilege: SELECT, INSERT, UPDATE, DELETE, or TRUNCATE for a table and EXECUTE for a function

nspname name

Name of the schema an object (table or function) is in

targetname name

Name of this object (table or function)

provider name

Name of the role through membership in which this role got this privilege

grantee name

Name of the role through membership in which this role got this privilege or "public" if this privilege was granted to all roles through GRANT ... TO PUBLIC.

kind text

Type of the object: FUNCTION or RELATION

used boolean

Whether this privilege was used


F.52.5. Configuration Parameters #

pgpro_usage.max (integer)

Defines the maximum number of pairs (object, user) for the statistics to store, where the object is a table or a function/procedure. Can be reduced to save the memory or increased for huge databases. If pgpro_usage needs to exceed this value when writing statistics, the new record is not created, and the WARNING: max number of pgpro_usage records exceeded warning is displayed.

The default value is 10000.

F.52.6. Example #

This example illustrates usage of the pgpro_usage extension.

First we create the extension:

postgres=# create extension pgpro_usage;
CREATE EXTENSION

Now let's try out the usage statistics. To do this, we create a user, table, and procedure and give the user access to the table:

postgres=# CREATE USER u1;
CREATE ROLE
postgres=# CREATE TABLE t1(val int);
CREATE TABLE
postgres=# GRANT all on t1 to u1;
GRANT
postgres=# CREATE PROCEDURE p1() AS $$ BEGIN RAISE NOTICE 'Here we are'; END; $$ LANGUAGE plpgsql;
CREATE PROCEDURE

Let's output all the usage statistics for all tables:

postgres=# SELECT * FROM pg_stat_all_tables_per_user;
 userid | username | relid | nspname | relname | n_reads | n_inserts | n_updates | n_deletes | n_truncates | n_grants_given
--------+----------+-------+---------+---------+---------+-----------+-----------+-----------+-------------+----------------
     10 | postgres | 16445 | public  | t1      |       0 |         0 |         0 |         0 |           0 |              1
(1 row)

Do so for all functions:

postgres=# SELECT * FROM pg_stat_all_functions_per_user;
 userid | username | funcid | nspname |                funcname                | calls | grants_given
--------+----------+--------+---------+----------------------------------------+-------+--------------
     10 | postgres | 16385  | public  | pgpro_usage_reset                      |     0 |            1
     10 | postgres | 16386  | public  | pgpro_usage                            |     0 |            1
     10 | postgres | 16387  | public  | pgpro_usage_full                       |     0 |            1
     10 | postgres | 16397  | public  | pg_stat_get_func_calls_per_user        |     2 |            0
     10 | postgres | 16398  | public  | pg_stat_get_func_grants_given_per_user |     1 |            0
     10 | postgres | 16399  | public  | pg_stat_get_read_req_per_user          |     1 |            0
     10 | postgres | 16400  | public  | pg_stat_get_insert_req_per_user        |     1 |            0
     10 | postgres | 16401  | public  | pg_stat_get_update_req_per_user        |     1 |            0
     10 | postgres | 16402  | public  | pg_stat_get_delete_req_per_user        |     1 |            0
     10 | postgres | 16403  | public  | pg_stat_get_truncate_req_per_user      |     1 |            0
     10 | postgres | 16404  | public  | pg_stat_get_grants_given_per_user      |     1 |            0
(11 rows)

In the above output, you can only see superuser operations, who once granted access on a table and several times called the extension functions when querying the above views. The grants_given column is non-zero in three rows. They correspond to revoking permissions from public during creation of the extension. The newly created user is not included in the statistics since he did nothing.

Let's fill this gap and connect to the database as the u1 user.

postgres=# \c - u1
You are now connected to database "postgres" as user "u1".
postgres=> insert into t1(val) values (1);
INSERT 0 1
postgres=> insert into t1(val) values (2);
INSERT 0 1
postgres=> select * from t1;
 val
-----
   1
   2
(2 rows)
postgres=> call p1();
NOTICE:  Here we are
CALL

We did two inserts in the table, queried it once, and once called the procedure. Let's switch back to the superuser and look at the statistics again:

postgres=> \c - postgres
You are now connected to database "postgres" as user "postgres".
postgres=# SELECT * FROM pg_stat_all_tables_per_user;
 userid | username | relid | nspname | relname | n_reads | n_inserts | n_updates | n_deletes | n_truncates | n_grants_given
--------+----------+-------+---------+---------+---------+-----------+-----------+-----------+-------------+----------------
  16444 | u1       | 16445 | public  | t1      |       1 |         2 |         0 |         0 |           0 |              0
     10 | postgres | 16445 | public  | t1      |       0 |         0 |         0 |         0 |           0 |              1
(2 rows)
postgres=# SELECT * FROM pg_stat_all_functions_per_user;
 userid | username | funcid | nspname |                funcname                | calls | grants_given
--------+----------+--------+---------+----------------------------------------+-------+--------------
     10 | postgres | 16385  | public  | pgpro_usage_reset                      |     0 |            1
     10 | postgres | 16386  | public  | pgpro_usage                            |     0 |            1
     10 | postgres | 16387  | public  | pgpro_usage_full                       |     0 |            1
     10 | postgres | 16397  | public  | pg_stat_get_func_calls_per_user        |     4 |            0
     10 | postgres | 16398  | public  | pg_stat_get_func_grants_given_per_user |     2 |            0
     10 | postgres | 16399  | public  | pg_stat_get_read_req_per_user          |     2 |            0
     10 | postgres | 16400  | public  | pg_stat_get_insert_req_per_user        |     2 |            0
     10 | postgres | 16401  | public  | pg_stat_get_update_req_per_user        |     2 |            0
     10 | postgres | 16402  | public  | pg_stat_get_delete_req_per_user        |     2 |            0
     10 | postgres | 16403  | public  | pg_stat_get_truncate_req_per_user      |     2 |            0
     10 | postgres | 16404  | public  | pg_stat_get_grants_given_per_user      |     2 |            0
  16444 | u1       | 16448  | public  | p1                                     |     1 |            0
(12 rows)

Both tables now include rows corresponding to the operations of the u1 user: two inserts and a read of the table and one execution of the procedure.

Now let's look at the last-use statistics. We will be able to see timestamps showing when the user performed the inserts and the read.

postgres=# select * from pg_stat_all_tables_last_usage;
 userid | username | nspname | relid | relname |           last_read           |         last_insert          | last_update | last_delete | last_truncate
--------+----------+---------+-------+---------+-------------------------------+------------------------------+-------------+-------------+---------------
  16444 | u1       | public  | 16445 | t1      | 2024-11-30 01:06:24.578642+03 | 2024-11-30 01:06:17.03442+03 |             |             |
(1 row)

Let's extend this statistics with a read by a superuser:

postgres=# select * from t1;
 val
-----
   1
   2
(2 rows)
postgres=# select * from pg_stat_all_tables_last_usage;
 userid | username | nspname | relid | relname |           last_read           |         last_insert          | last_update | last_delete | last_truncate
--------+----------+---------+-------+---------+-------------------------------+------------------------------+-------------+-------------+---------------
     10 | postgres | public  | 16445 | t1      | 2024-11-30 01:09:29.994188+03 |                              |             |             |
  16444 | u1       | public  | 16445 | t1      | 2024-11-30 01:06:24.578642+03 | 2024-11-30 01:06:17.03442+03 |             |             |
(2 rows)

Let's make sure that the last_read timestamp gets updated:

postgres=# select * from t1;
 val
-----
   1
   2
(2 rows)
postgres=# select * from pg_stat_all_tables_last_usage;
 userid | username | nspname | relid | relname |           last_read           |         last_insert          | last_update | last_delete | last_truncate
--------+----------+---------+-------+---------+-------------------------------+------------------------------+-------------+-------------+---------------
     10 | postgres | public  | 16445 | t1      | 2024-11-30 01:10:28.122489+03 |                              |             |             |
  16444 | u1       | public  | 16445 | t1      | 2024-11-30 01:06:24.578642+03 | 2024-11-30 01:06:17.03442+03 |             |             |
(2 rows)

Now let's consider the statistics on unused privileges. Since there can be quite a lot of objects, users, and privileges, let's put everything related to this example in a separate schema to make it easier to filter the future result. We create a schema and a table in it, grant access on the table to a certain group role, and grant membership in this group role to a specific user:

postgres=# create schema shops;
CREATE SCHEMA
postgres=# create table shops.buildings();
CREATE TABLE
postgres=# create role manager;
CREATE ROLE
postgres=# grant all on schema shops to manager;
GRANT
postgres=# grant all on shops.buildings to manager;
GRANT
postgres=# create user vasya;
CREATE ROLE
postgres=# grant manager to vasya;
GRANT ROLE

Let's connect to the database as this user and query the table:

postgres=# \c - vasya
You are now connected to database "postgres" as user "vasya".
postgres=> select * from shops.buildings;
--
(0 rows)

Now let's switch to the superuser and look at the statistics on privileges:

postgres=> \c - postgres
You are now connected to database "postgres" as user "postgres".
postgres=# select * from pgpro_usage_stats_privileges_usage where usename='vasya' and nspname='shops';
 usename |  access  | nspname | targetname | provider | grantee |   kind   | used
---------+----------+---------+------------+----------+---------+----------+------
 vasya   | INSERT   | shops   | buildings  | manager  | manager | RELATION | f
 vasya   | SELECT   | shops   | buildings  | manager  | manager | RELATION | t
 vasya   | UPDATE   | shops   | buildings  | manager  | manager | RELATION | f
 vasya   | DELETE   | shops   | buildings  | manager  | manager | RELATION | f
 vasya   | TRUNCATE | shops   | buildings  | manager  | manager | RELATION | f
(5 rows)

These statistics show that the user vasya has full access to the shops.buildings table, and he got all the access privileges indirectly, as a memeber of the manager role. It is also clear that among the privileges, vasya only used SELECT. Note also that the statistics on privileges do not show superuser privileges: evidently, superuser has full access.