Re: [GENERAL] Load multiple CSV file in Postgres using COPY - Mailing list pgsql-general

From Alexander Shchapov
Subject Re: [GENERAL] Load multiple CSV file in Postgres using COPY
Date
Msg-id CAOVT1411xthCrcdFYfxLN+eFG18WhyUA2QmtUQk4aMpxtp_noA@mail.gmail.com
Whole thread Raw
In response to [GENERAL] Load multiple CSV file in Postgres using COPY  (Murtuza Zabuawala <murtuza.zabuawala@enterprisedb.com>)
Responses Re: [GENERAL] Load multiple CSV file in Postgres using COPY  (Murtuza Zabuawala <murtuza.zabuawala@enterprisedb.com>)
List pgsql-general
You might want to look into pgloader: http://pgloader.io/

On Fri, Feb 17, 2017 at 7:26 AM, Murtuza Zabuawala
<murtuza.zabuawala@enterprisedb.com> wrote:
> Hi,
>
> Is there any way to load multiple CSV files at once using single COPY
> command?
>
> I have scenario where I have to load multiple files,
>
> COPY prdxgdat FROM 'Z:/data-2016-04-01.csv' WITH DELIMITER ',' CSV HEADER Y
> COPY prdxgdat FROM 'Z:/data-2016-04-02.csv' WITH DELIMITER ',' CSV HEADER Y
> COPY prdxgdat FROM 'Z:/data-2016-04-03.csv' WITH DELIMITER ',' CSV HEADER Y
> COPY prdxgdat FROM 'Z:/data-2016-04-04.csv' WITH DELIMITER ',' CSV HEADER Y
> COPY prdxgdat FROM 'Z:/data-2016-04-05.csv' WITH DELIMITER ',' CSV HEADER Y
> COPY prdxgdat FROM 'Z:/data-2016-04-06.csv' WITH DELIMITER ',' CSV HEADER Y
> ..
> ..
> ..
> ..
> COPY prdxgdat FROM 'Z:/data-2016-04-50.csv' WITH DELIMITER ',' CSV HEADER Y
>
> 50 files -> 50 COPY command, In my use case I think this is not a good way
> to load data, Can you suggest any better way to do this?
>
> I can always write external script (eg: shell script) but is there any other
> way to do this using single COPY command?
>
> --
> Regards,
> Murtuza Zabuawala
> EnterpriseDB: http://www.enterprisedb.com
> The Enterprise PostgreSQL Company



--
Alexander Shchapov


pgsql-general by date:

Previous
From: Michael Tyson
Date:
Subject: [GENERAL] "Database does not exist" weirdness
Next
From: Hannes Erven
Date:
Subject: Re: [GENERAL] Autovacuum stuck for hours, blocking queries