On Tue, Jun 19, 2018 at 02:32:10PM -0700, David G. Johnston wrote:
> You really need to describe what you consider to be a "real life
> scenario"; and probably give a better idea of creation and number of these
> csv files. In addition to describing the relevant behavior of the
> application you are testing.
>
> If you want maximum realism you should probably write integration tests for
> your application and then execute those at high volume.
>
> Or at minimum give an example of the output you would want from this
> unknown program...
Hard to say what you are especially looking for that psql's \copy cannot
do, but perhaps you have an interest in pg_bulkload? Here is a link to
the project:
https://github.com/ossc-db/pg_bulkload/
It has a couple of fancy features as well, like preventing failures of
rows if loading a large file, etc.
--
Michael
