pgsql: Allow pgbench to retry in some cases. - Mailing list pgsql-committers

From Tatsuo Ishii
Subject pgsql: Allow pgbench to retry in some cases.
Date
Msg-id E1nWxtC-0010KS-07@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
Allow pgbench to retry in some cases.

When serialization or deadlock errors are reported by backend, allow
to retry and continue the benchmarking. For this purpose new options
"--max-tries", "--failures-detailed" and "--verbose-errors" are added.

Transactions with serialization errors or deadlock errors will be
repeated after rollbacks until they complete successfully or reach the
maximum number of tries (specified by the --max-tries option), or the
maximum time of tries (specified by the --latency-limit option).
These options can be specified at the same time. It is not possible to
use an unlimited number of tries (--max-tries=0) without the
--latency-limit option or the --time option. By default the option
--max-tries is set to 1, which means transactions with
serialization/deadlock errors are not retried. If the last try fails,
this transaction will be reported as failed, and the client variables
will be set as they were before the first run of this transaction.

Statistics on retries and failures are printed in the progress,
transaction / aggregation logs and in the end with other results (all
and for each script). Also retries and failures are printed
per-command with average latency by using option
(--report-per-command, -r).

Option --failures-detailed prints group failures by basic types
(serialization failures / deadlock failures).

Option --verbose-errors prints distinct reports on errors and failures
(errors without retrying) by type with detailed information like which
limit for retries was violated and how far it was exceeded for the
serialization/deadlock failures.

Patch originally written by Marina Polyakova then Yugo Nagata
inherited the discussion and heavily modified the patch to make it
commitable.

Authors: Yugo Nagata, Marina Polyakova
Reviewed-by: Fabien Coelho, Tatsuo Ishii, Alvaro Herrera, Kevin Grittner, Andres Freund, Arthur Zakirov, Alexander
Korotkov,Teodor Sigaev, Ildus Kurbangaliev 
Discussion: https://postgr.es/m/flat/72a0d590d6ba06f242d75c2e641820ec%40postgrespro.ru

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/4a39f87acd6e681e5ded1239391d8a92645b43d6

Modified Files
--------------
doc/src/sgml/ref/pgbench.sgml                |  431 ++++++++--
src/bin/pgbench/pgbench.c                    | 1128 ++++++++++++++++++++++----
src/bin/pgbench/t/001_pgbench_with_server.pl |  215 ++++-
src/bin/pgbench/t/002_pgbench_no_server.pl   |   10 +
src/fe_utils/conditional.c                   |   16 +-
src/include/fe_utils/conditional.h           |    2 +
6 files changed, 1594 insertions(+), 208 deletions(-)


pgsql-committers by date:

Previous
From: Alvaro Herrera
Date:
Subject: Re: pgsql: Common SQL/JSON clauses
Next
From: Andrew Dunstan
Date:
Subject: Re: pgsql: Common SQL/JSON clauses