Re: Page Checksums + Double Writes - Mailing list pgsql-hackers

From Jeff Janes
Subject Re: Page Checksums + Double Writes
Date
Msg-id CAMkU=1yDc_OK4Rs=YrK7cANQXSuYkaOezJ3LbiG_XVeNauE7TQ@mail.gmail.com
Whole thread Raw
In response to Re: Page Checksums + Double Writes  (Robert Haas <robertmhaas@gmail.com>)
Responses Re: Page Checksums + Double Writes  ("Kevin Grittner" <Kevin.Grittner@wicourts.gov>)
Re: Page Checksums + Double Writes  (Tom Lane <tgl@sss.pgh.pa.us>)
List pgsql-hackers
On 12/23/11, Robert Haas <robertmhaas@gmail.com> wrote:
> On Fri, Dec 23, 2011 at 11:14 AM, Kevin Grittner
> <Kevin.Grittner@wicourts.gov> wrote:
>> Thoughts?
>
> Those are good thoughts.
>
> Here's another random idea, which might be completely nuts.  Maybe we
> could consider some kind of summarization of CLOG data, based on the
> idea that most transactions commit.

I had a perhaps crazier idea. Aren't CLOG pages older than global xmin
effectively read only?  Could backends that need these bypass locking
and shared memory altogether?

> An obvious problem is that, if the abort rate is significantly
> different from zero, and especially if the aborts are randomly mixed
> in with commits rather than clustered together in small portions of
> the XID space, the CLOG rollup data would become useless.  On the
> other hand, if you're doing 10k tps, you only need to have a window of
> a tenth of a second or so where everything commits in order to start
> getting some benefit, which doesn't seem like a stretch.

Could we get some major OLTP users to post their CLOG for analysis?  I
wouldn't think there would be much security/propietary issues with
CLOG data.

Cheers,

Jeff


pgsql-hackers by date:

Previous
From: Heikki Linnakangas
Date:
Subject: Re: Moving more work outside WALInsertLock
Next
From: "Kevin Grittner"
Date:
Subject: Re: Page Checksums + Double Writes