Hi,
PgLoader is the python ETL tool for PostgreSQL, supporting a lot of (possibly
convoluted) input formats, and able to load files in parallel. Either loading
several files at once (each in its own PG connection) or the same file in
several connections (two collaborative models implemented).
http://pgloader.projects.postgresql.org/
This new version of pgloader has seen some testing of max_parallel_sections
setting, a user was able to load 1000 files using 10 parallel sections.
Version 2.3.1 also supports fixed file format, where no field separator exists
but each field length is known (and fixed). This premature support does not
offer any facility for stripping (left, right or both), I'll work on this if
there's any demand.
The changelog also misses to specify escape characters are now supported for
configuring field_sep, such as \t for example.
Regards,
--
dim
