Re: COPY enhancements - Mailing list pgsql-hackers

From Tom Lane
Subject Re: COPY enhancements
Date
Msg-id 20524.1252877639@sss.pgh.pa.us
Whole thread Raw
In response to Re: COPY enhancements  (Josh Berkus <josh@agliodbs.com>)
Responses Re: COPY enhancements
Re: COPY enhancements
List pgsql-hackers
Josh Berkus <josh@agliodbs.com> writes:
> It's not as if we don't have the ability to measure performance impact.
>  It's reasonable to make a requirement that new options to COPY
> shouldn't slow it down noticeably if those options aren't used.  And we
> can test that, and even make such testing part of the patch review.

Really?  Where is your agreed-on, demonstrated-to-be-reproducible
benchmark for COPY speed?

My experience is that reliably measuring performance costs in the
percent-or-so range is *hard*.  It's only after you've added a few of
them and they start to mount up that it becomes obvious that all those
insignificant additions really did cost something.

But in any case, I think that having a clear distinction between
"straight data import" and "data transformation" features is a good
thing.  COPY is already pretty much of an unmanageable monstrosity,
and continuing to accrete features into it without any sort of structure
is something we are going to regret.
        regards, tom lane


pgsql-hackers by date:

Previous
From: Josh Berkus
Date:
Subject: Re: COPY enhancements
Next
From: decibel
Date:
Subject: Re: RfD: more powerful "any" types