Re: Inconsistent DB data in Streaming Replication - Mailing list pgsql-hackers

From Shaun Thomas
Subject Re: Inconsistent DB data in Streaming Replication
Date
Msg-id 51657683.1070408@optionshouse.com
Whole thread Raw
In response to Re: Inconsistent DB data in Streaming Replication  (Tom Lane <tgl@sss.pgh.pa.us>)
Responses Re: Inconsistent DB data in Streaming Replication
List pgsql-hackers
On 04/10/2013 09:10 AM, Tom Lane wrote:

> IOW, I wouldn't consider skipping the rsync even if I had a feature
> like this.

Totally. Out in the field, we consider the "old" database corrupt the 
moment we fail over. There is literally no way to verify the safety of 
any data along the broken chain, given race conditions and multiple 
potential failure points.

The only potential use case for this that I can see, would be for system 
maintenance and a controlled failover. I agree: that's a major PITA when 
doing DR testing, but I personally don't think this is the way to fix 
that particular edge case.

Maybe checksums will fix this in the long run... I don't know. DRBD has 
a handy block-level verify function for things like this, and it can 
re-sync master/slave data by comparing the commit log across the servers 
if you tell it one node should be considered incorrect.

The thing is... we have clogs, and we have WAL. If we can assume 
bidirectional communication and verification (checksum comparison?) of 
both of those components, the database *should* be able to re-sync itself.

Even if that were possible given the internals, I can't see anyone 
jumping on this before 9.4 or 9.5 unless someone sponsors the feature.

Automatic re-sync would (within available WALs) be an awesome feature, 
though...

-- 
Shaun Thomas
OptionsHouse | 141 W. Jackson Blvd. | Suite 500 | Chicago IL, 60604
312-676-8870
sthomas@optionshouse.com

______________________________________________

See http://www.peak6.com/email_disclaimer/ for terms and conditions related to this email



pgsql-hackers by date:

Previous
From: Bruce Momjian
Date:
Subject: Re: Enabling Checksums
Next
From: Dang Minh Huong
Date:
Subject: Re: [BUGS] replication_timeout not effective