pgsql: Add new COPY option SAVE_ERROR_TO - Mailing list pgsql-committers

From Alexander Korotkov
Subject pgsql: Add new COPY option SAVE_ERROR_TO
Date
Msg-id E1rPr5S-001ke5-GU@gemulon.postgresql.org
Whole thread Raw
Responses Re: pgsql: Add new COPY option SAVE_ERROR_TO
List pgsql-committers
Add new COPY option SAVE_ERROR_TO

Currently, when source data contains unexpected data regarding data type or
range, the entire COPY fails. However, in some cases, such data can be ignored
and just copying normal data is preferable.

This commit adds a new option SAVE_ERROR_TO, which specifies where to save the
error information. When this option is specified, COPY skips soft errors and
continues copying.

Currently, SAVE_ERROR_TO only supports "none". This indicates error information
is not saved and COPY just skips the unexpected data and continues running.

Later works are expected to add more choices, such as 'log' and 'table'.

Author: Damir Belyalov, Atsushi Torikoshi, Alex Shulgin, Jian He
Discussion: https://postgr.es/m/87k31ftoe0.fsf_-_%40commandprompt.com
Reviewed-by: Pavel Stehule, Andres Freund, Tom Lane, Daniel Gustafsson,
Reviewed-by: Alena Rybakina, Andy Fan, Andrei Lepikhov, Masahiko Sawada
Reviewed-by: Vignesh C, Atsushi Torikoshi

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/9e2d8701194fa1d280b73c024759950c74c1c637

Modified Files
--------------
doc/src/sgml/ref/copy.sgml               | 23 ++++++++++++++-
src/backend/commands/copy.c              | 49 ++++++++++++++++++++++++++++++++
src/backend/commands/copyfrom.c          | 48 +++++++++++++++++++++++++++++++
src/backend/commands/copyfromparse.c     | 17 +++++++----
src/bin/psql/tab-complete.c              |  7 ++++-
src/include/commands/copy.h              | 11 +++++++
src/include/commands/copyfrom_internal.h |  5 ++++
src/test/regress/expected/copy2.out      | 43 ++++++++++++++++++++++++++++
src/test/regress/sql/copy2.sql           | 42 +++++++++++++++++++++++++++
src/tools/pgindent/typedefs.list         |  1 +
10 files changed, 239 insertions(+), 7 deletions(-)


pgsql-committers by date:

Previous
From: David Rowley
Date:
Subject: pgsql: Fix REALLOCATE_BITMAPSETS code
Next
From: Alexander Korotkov
Date:
Subject: Re: pgsql: Add new COPY option SAVE_ERROR_TO