Re: [RFC] LSN Map - Mailing list pgsql-hackers

From Bruce Momjian
Subject Re: [RFC] LSN Map
Date
Msg-id 20150107151619.GG17824@momjian.us
Whole thread Raw
In response to [RFC] LSN Map  (Marco Nenciarini <marco.nenciarini@2ndquadrant.it>)
Responses Re: [RFC] LSN Map
List pgsql-hackers
On Wed, Jan  7, 2015 at 10:50:38AM +0100, Marco Nenciarini wrote:
> Implementation
> --------------
> 
> We create an additional fork which contains a raw stream of LSNs. To
> limit the space used, every entry represent the maximum LSN of a group
> of blocks of a fixed size. I chose arbitrarily the size of 2048
> which is equivalent to 16MB of heap data, which means that we need 64k
> entry to track one terabyte of heap.

I like the idea of summarizing the LSN to keep its size reaonable.  Have
you done any measurements to determine how much backup can be skipped
using this method for a typical workload, i.e. how many 16MB page ranges
are not modified in a typical span between incremental backups?

--  Bruce Momjian  <bruce@momjian.us>        http://momjian.us EnterpriseDB
http://enterprisedb.com
 + Everyone has their own god. +



pgsql-hackers by date:

Previous
From: Kevin Grittner
Date:
Subject: Re: Turning recovery.conf into GUCs
Next
From: Alvaro Herrera
Date:
Subject: Re: [RFC] LSN Map