Re: Comparing two (largish) tables on different servers - Mailing list pgsql-sql

From Michael Fuhr
Subject Re: Comparing two (largish) tables on different servers
Date
Msg-id 20041110193250.GA18174@winnie.fuhr.org
Whole thread Raw
In response to Re: Comparing two (largish) tables on different servers  (Sam Mason <sam@samason.me.uk>)
List pgsql-sql
On Wed, Nov 10, 2004 at 09:18:21AM +0000, Sam Mason wrote:
> 
>   mkfifo db1
>   psql -h "db1" -t -q -c "$query" > db1
>   mkfifo db2
>   psql -h "db2" -t -q -c "$query" > db2
>   diff -u -0 db1 db2

This should work for small data sets, but the OP said the tables
were about 5G.  Unless you use a cursor, psql will fetch the entire
result before writing anything.  Also, some implementations of diff
might read all of the data from one file before reading much from
the other file, especially if the files have differences.  Hope
you have lots of memory....

-- 
Michael Fuhr
http://www.fuhr.org/~mfuhr/


pgsql-sql by date:

Previous
From: "Goutam Paruchuri"
Date:
Subject: Re: Error In connection ??
Next
From: Stefan Weiss
Date:
Subject: Re: A transaction in transaction? Possible?