Re: COPY enhancements - Mailing list pgsql-hackers

From Emmanuel Cecchet
Subject Re: COPY enhancements
Date
Msg-id 4AB3091A.5020506@asterdata.com
Whole thread Raw
In response to COPY enhancements  (Emmanuel Cecchet <manu@asterdata.com>)
Responses Re: COPY enhancements
List pgsql-hackers
Here is a new version of error logging and autopartitioning in COPY
based on the latest COPY patch that provides the new syntax for copy
options (this patch also includes the COPY option patch).

New features compared to previous version:
- removed the GUC variables for error logging and use copy options
instead (renamed options as suggested by Josh)
- added documentation and examples (see copy.sgml)
- partitioning also activated by copy option rather than GUC variable
(renamed as well)
- added a new ERROR_LOGGING_MAX_ERRORS option that allows to abort the
COPY operation if a certain number of bad rows has been encountered.
- updated unit tests

I also tried to update the wiki pages but it's late and the doc is
probably better for now.

This addresses most of the comments so far except for the format of the
error table (lack of natural key) and a possible pg_error_table as a
default name.

Emmanuel

Emmanuel Cecchet wrote:
> Hi all,
>
> Finally the error logging and autopartitioning patches for COPY that I
> presented at PGCon are here!
> Error logging is described here:
> http://wiki.postgresql.org/wiki/Error_logging_in_COPY
> Autopartitioning is described here:
> http://wiki.postgresql.org/wiki/Auto-partitioning_in_COPY
>
> The attached patch contains both contribs as well as unit tests. I
> will submit shortly the new patch at commitfest.postgresql.org.
>
> Thanks in advance for your feedback,
> Emmanuel
>
> ------------------------------------------------------------------------
>
>
>


--
Emmanuel Cecchet
Aster Data Systems
Web: http://www.asterdata.com


Attachment

pgsql-hackers by date:

Previous
From: Robert Fleming
Date:
Subject: Re: LDAP where DN does not include UID attribute
Next
From: Jeff Janes
Date:
Subject: Re: Bulk Inserts