inserting only new rows from csv file - Mailing list pgsql-general

From Seb
Subject inserting only new rows from csv file
Date
Msg-id 87k5csf22r.fsf@patagonia.sebmags.homelinux.org
Whole thread Raw
Responses Re: inserting only new rows from csv file  ("Scott Marlowe" <scott.marlowe@gmail.com>)
List pgsql-general
Hi,

I've seen some approaches to this problem, but I suspect there are
better ways.

A csv file is produced nightly, with the same table structure as a table
in a PostgreSQL database.  The file grows over time as new records are
added every day.  However, the rows in the file may not be sorted the
same way every day.

I need to isolate the new rows and insert them into the database table.
Before I start writing a script to do this, I need to decide whether to
do the comparison between the database table and the csv file: a) within
the database, or b) COPY'ing the table to a file and then do the
comparison.  I'm not very experienced with SQL, so am more comfortable
with the latter option using plain shell and awk.  Which route is best?
If a), I'd appreciate some SQL code to do it.  Thanks.


Cheers,

--
Seb

pgsql-general by date:

Previous
From: Mike Christensen
Date:
Subject: Re: Index question regarding numeric operators
Next
From: "Dennis Brakhane"
Date:
Subject: Re: Transactions within a function body