Re: [REVIEW] Re: Compression of full-page-writes - Mailing list pgsql-hackers

From Andres Freund
Subject Re: [REVIEW] Re: Compression of full-page-writes
Date
Msg-id 20140912203119.GC23806@awork2.anarazel.de
Whole thread Raw
In response to Re: [REVIEW] Re: Compression of full-page-writes  (Heikki Linnakangas <hlinnakangas@vmware.com>)
List pgsql-hackers
On 2014-09-12 22:38:01 +0300, Heikki Linnakangas wrote:
> It's worth noting that there are faster CRC implementations out there than
> what we use. The Slicing-by-4 algorithm was discussed years ago, but was not
> deemed worth it back then IIRC because we typically calculate CRC over very
> small chunks of data, and the benefit of Slicing-by-4 and many other
> algorithms only show up when you work on larger chunks. But a full-page
> image is probably large enough to benefit.

I've recently pondered moving things around so the CRC sum can be
computed over the whole data instead of the individual chain elements. I
think, regardless of the checksum algorithm and implementation we end up
with, that might end up as a noticeable benefit.

Greetings,

Andres Freund

-- Andres Freund                       http://www.2ndQuadrant.com/PostgreSQL Development, 24x7 Support, Training &
Services



pgsql-hackers by date:

Previous
From: Alexander Korotkov
Date:
Subject: Re: jsonb contains behaviour weirdness
Next
From: Heikki Linnakangas
Date:
Subject: Re: jsonb format is pessimal for toast compression