Postgres Pro
Downloads
Home   >   mailing lists

Re: [GENERAL] Load multiple CSV file in Postgres using COPY - Mailing list pgsql-general

From Magnus Hagander
Subject Re: [GENERAL] Load multiple CSV file in Postgres using COPY
Date
Msg-id CABUevEyxubgr9AiVDxPX6koaqkfQZv=onL+kw6RsJUXgKdhOKg@mail.gmail.com
Whole thread Raw
In response to [GENERAL] Load multiple CSV file in Postgres using COPY  (Murtuza Zabuawala <murtuza.zabuawala@enterprisedb.com>)
Responses Re: [GENERAL] Load multiple CSV file in Postgres using COPY  (John R Pierce <pierce@hogranch.com>)
List pgsql-general
Tree view
On Fri, Feb 17, 2017 at 6:26 AM, Murtuza Zabuawala <murtuza.zabuawala@enterprisedb.com> wrote:
Hi,

Is there any way to load multiple CSV files at once using single COPY command?

I have scenario where I have to load multiple files,

COPY prdxgdat FROM 'Z:/data-2016-04-01.csv' WITH DELIMITER ',' CSV HEADER Y
COPY prdxgdat FROM 'Z:/data-2016-04-02.csv' WITH DELIMITER ',' CSV HEADER Y
COPY prdxgdat FROM 'Z:/data-2016-04-03.csv' WITH DELIMITER ',' CSV HEADER Y
COPY prdxgdat FROM 'Z:/data-2016-04-04.csv' WITH DELIMITER ',' CSV HEADER Y
COPY prdxgdat FROM 'Z:/data-2016-04-05.csv' WITH DELIMITER ',' CSV HEADER Y
COPY prdxgdat FROM 'Z:/data-2016-04-06.csv' WITH DELIMITER ',' CSV HEADER Y
..
..
..
..
COPY prdxgdat FROM 'Z:/data-2016-04-50.csv' WITH DELIMITER ',' CSV HEADER Y

50 files -> 50 COPY command, In my use case I think this is not a good way to load data, Can you suggest any better way to do this?

I can always write external script (eg: shell script) but is there any other way to do this using single COPY command?


Perhaps something like "COPY FROM PROGRAM 'cat /path/*.csv'" would work for you?


--
 Magnus Hagander
 Me: http://www.hagander.net/
 Work: http://www.redpill-linpro.com/

pgsql-general by date:

Previous
From: Murtuza Zabuawala
Date:
Subject: [GENERAL] Load multiple CSV file in Postgres using COPY
Next
From: John R Pierce
Date:
Subject: Re: [GENERAL] Load multiple CSV file in Postgres using COPY