Re: Finding Duplicate Rows during INSERTs - Mailing list pgsql-general

On Mon, 9 Jul 2012, Rob Sargent wrote:

> psql -d <database> -f file.sql > file.log 2>&1 would give you a logfile

Rob,

   Ah, yes. I forgot about redirecting stdout to a file.

> sort -u file.raw > file.uniq might give you clean data?

   Not when it has the SQL on each line. I thought that I had eliminated
duplicates in the raw file, but with 128K rows I obviously missed many.

Thanks,

Rich