Re: Howto import regularly some CSV files with variing names? - Mailing list pgsql-general

From Adrian Klaver
Subject Re: Howto import regularly some CSV files with variing names?
Date
Msg-id 5240E770.2010901@gmail.com
Whole thread Raw
In response to Re: Howto import regularly some CSV files with variing names?  (Andreas <maps.on@gmx.net>)
Responses Re: Howto import regularly some CSV files with variing names?  (Rowan Collins <rowan.collins@gmail.com>)
List pgsql-general
On 09/23/2013 05:47 PM, Andreas wrote:
> Am 24.09.2013 02:25, schrieb Adrian Klaver:
>> On 09/23/2013 05:19 PM, Andreas wrote:
>>>
>>> I need to import some log-files of an application [...]
>>> The import would be easy if the files had a constant name but the app
>>> creates csv files with names like "ExportYYYYMMDD".
>>>
>>>
>>> So   how would I get the filenames into the sql-script?
>>
>> Do man on find and look for -exec.
>>
>
> I could find the files and exec a shell script but how can I have a SQL
> script take the found filenames as parameter?
>
> The SQL script needs to create a temp table
> then COPY the file with the filename it got as parameter into the temp
> table
> then insert from there into the log-table
>
> How would I get the filenames into the SQL script?

Just a thought:

1) Create a function that encapsulates the above logic where the
argument is the file name.

2) Create a shell script. Use substitution to take the filename passed
to the shell script to build a string and in the script do

psql -d db_name -U user_name -c 'select the function(filename)'

2a) Use alternate language to do 2).
--
Adrian Klaver
adrian.klaver@gmail.com


pgsql-general by date:

Previous
From: hxreno1
Date:
Subject: Re: How to create recurrence schedule event?
Next
From: Ray Stell
Date:
Subject: Re: streaming replication not working