Thread: Data merging problem

Data merging problem

From
subodh chaudhari
Date:
Hi ,
I am working on project which include merging of two databases within postgresql on Linux.  I have searched for s/w but didnt get any useful. So if any one having any information about such s/w please help me out. This s/w should have GPL. (Opensource s/w). I want to sync two database i.e. the s/w should merge the databses insuch a way that they sholud have same tables and also same records in table. It should generate script using which I can sync two databases.

--
Thanks,
Subodh Chaudhari

Re: Data merging problem

From
John R Pierce
Date:
subodh chaudhari wrote:
> Hi ,
> I am working on project which include merging of two databases within
> postgresql on Linux.  I have searched for s/w but didnt get any
> useful. So if any one having any information about such s/w please
> help me out. This s/w should have GPL. (Opensource s/w). I want to
> sync two database i.e. the s/w should merge the databses insuch a way
> that they sholud have same tables and also same records in table. It
> should generate script using which I can sync two databases.

and how should this free program it handle little things like constraint
violations caused by duplicate primary keys, and so forth?



Re: Data merging problem

From
Thomas Kellerer
Date:
subodh chaudhari, 17.06.2009 09:05:
> Hi ,
> I am working on project which include merging of two databases within
> postgresql on Linux.  I have searched for s/w but didnt get any useful.
> So if any one having any information about such s/w please help me out.
> This s/w should have GPL. (Opensource s/w). I want to sync two database
> i.e. the s/w should merge the databses insuch a way that they sholud
> have same tables and also same records in table. It should generate
> script using which I can sync two databases.

Why don't you use Slony or some similar replication solution for Postgres?
They are mode precisely for that.


If you can't (or don't want to) use replication, you might want to have a look at my SQL Workbench/J.

It offers two commands that could do what you want:

WbSchemaDiff[1] which generates an XML description of the schema differences (which can then be transformed into a SQL
script)

WbDataDiff[2] can compare the contents (data) of two databases and either run the necessary UPDATE/DELETE/INSERT
statementsdirectly or write them as SQL scripts. Especially generating the DELETE  


http://www.sql-workbench.com

Thomas

[1] http://www.sql-workbench.net/manual/wb-commands.html#command-schema-diff
[2] http://www.sql-workbench.net/manual/wb-commands.html#command-data-diff