Re: [PATCH] Incremental backup: add backup profile to base backup - Mailing list pgsql-hackers

From Claudio Freire
Subject Re: [PATCH] Incremental backup: add backup profile to base backup
Date
Msg-id CAGTBQpZatSD0JZ-1D7V2cxeV-9cVQS6_Hx_ANdc+Lr+wOacMFg@mail.gmail.com
Whole thread Raw
In response to Re: [PATCH] Incremental backup: add backup profile to base backup  (Bruce Momjian <bruce@momjian.us>)
Responses Re: [PATCH] Incremental backup: add backup profile to base backup
List pgsql-hackers
On Wed, Aug 20, 2014 at 8:24 PM, Bruce Momjian <bruce@momjian.us> wrote:
> On Mon, Aug 18, 2014 at 04:05:07PM +0300, Heikki Linnakangas wrote:
>> But more to the point, I thought the consensus was to use the
>> highest LSN of all the blocks in the file, no? That's essentially
>> free to calculate (if you have to read all the data anyway), and
>> isn't vulnerable to collisions.
>
> The highest-LSN approach allows you to read only the tail part of each
> 8k block.  Assuming 512-byte storage sector sizes, you only have to read
> 1/8 of the file.
>
> Now, the problem is that you lose kernel prefetch, but maybe
> posix_fadvise() would fix that problem.

Sequential read of 512-byte blocks or 8k blocks takes the same amount
of time in rotating media (if they're scheduled right). Maybe not in
SSD media.

Not only, the kernel will read in 4k blocks, instead of 8k (at least in linux).

So, the benefit is dubious.



pgsql-hackers by date:

Previous
From: Andres Freund
Date:
Subject: Re: Proposal to add a QNX 6.5 port to PostgreSQL
Next
From: Andres Freund
Date:
Subject: Re: Proposal to add a QNX 6.5 port to PostgreSQL