Introduce a non-recursive JSON parser
This parser uses an explicit prediction stack, unlike the present
recursive descent parser where the parser state is represented on the
call stack. This difference makes the new parser suitable for use in
incremental parsing of huge JSON documents that cannot be conveniently
handled piece-wise by the recursive descent parser. One potential use
for this will be in parsing large backup manifests associated with
incremental backups.
Because this parser is somewhat slower than the recursive descent
parser, it is not replacing that parser, but is an additional parser
available to callers.
For testing purposes, if the build is done with -DFORCE_JSON_PSTACK, all
JSON parsing is done with the non-recursive parser, in which case only
trivial regression differences in error messages should be observed.
Author: Andrew Dunstan
Reviewed-By: Jacob Champion
Discussion: https://postgr.es/m/7b0a51d6-0d9d-7366-3a1a-f74397a02f55@dunslane.net
Branch
------
master
Details
-------
https://git.postgresql.org/pg/commitdiff/3311ea86edc7a689614bad754e17371865cdc11f
Modified Files
--------------
src/common/jsonapi.c | 954 +-
src/include/common/jsonapi.h | 30 +
src/include/pg_config_manual.h | 7 +
src/test/modules/Makefile | 1 +
src/test/modules/meson.build | 1 +
src/test/modules/test_json_parser/Makefile | 36 +
src/test/modules/test_json_parser/README | 25 +
src/test/modules/test_json_parser/meson.build | 52 +
.../t/001_test_json_parser_incremental.pl | 23 +
src/test/modules/test_json_parser/t/002_inline.pl | 83 +
.../test_json_parser/t/003_test_semantic.pl | 36 +
.../test_json_parser_incremental.c | 320 +
.../test_json_parser/test_json_parser_perf.c | 86 +
src/test/modules/test_json_parser/tiny.json | 378 +
src/test/modules/test_json_parser/tiny.out | 19534 +++++++++++++++++++
src/tools/pgindent/typedefs.list | 6 +
16 files changed, 21563 insertions(+), 9 deletions(-)
