Re: [Proposal] Page Compression for OLTP - Mailing list pgsql-hackers

From vignesh C
Subject Re: [Proposal] Page Compression for OLTP
Date
Msg-id CALDaNm04RD4EJiS32VXQEyf4sHzgfzopmgykpSm4hOBQisCWMQ@mail.gmail.com
Whole thread Raw
In response to Re: [Proposal] Page Compression for OLTP  (Ian Lawrence Barwick <barwick@gmail.com>)
List pgsql-hackers
On Fri, 4 Nov 2022 at 07:02, Ian Lawrence Barwick <barwick@gmail.com> wrote:
>
> 2022年7月27日(水) 2:47 chenhj <chjischj@163.com>:
> >
> > Hi hackers,
> >
> > I have rebase this patch and made some improvements.
> >
> >
> > 1. A header is added to each chunk in the pcd file, which records the chunk of which block the chunk belongs to,
andthe checksum of the chunk. 
> >
> >   Accordingly, all pages in a compressed relation are stored in compressed format, even if the compressed page is
largerthan BLCKSZ. 
> >
> >   The maximum space occupied by a compressed page is BLCKSZ + chunk_size (exceeding this range will report an error
whenwriting the page). 
> >
> > 2. Repair the pca file through the information recorded in the pcd when recovering from a crash
> >
> > 3. For compressed relation, do not release the free blocks at the end of the relation (just like what
old_snapshot_thresholddoes), reducing the risk of data inconsistency between pcd and pca file. 
> >
> > 4. During backup, only check the checksum in the chunk header for the pcd file, and avoid assembling and
decompressingchunks into the original page. 
> >
> > 5. bugfix, doc, code style and so on
> >
> >
> > And see src/backend/storage/smgr/README.compression for detail
> >
> >
> > Other
> >
> > 1. remove support of default compression option in tablespace, I'm not sure about the necessity of this feature, so
don'tsupport it for now. 
> >
> > 2. pg_rewind currently does not support copying only changed blocks from pcd file. This feature is relatively
independentand could be implemented later. 
>
> Hi
>
> cfbot reports the patch no longer applies.  As CommitFest 2022-11 is
> currently underway, this would be an excellent time to update the patch.

There has been no updates on this thread for some time, so this has
been switched as Returned with Feedback. Feel free to open it in the
next commitfest if you plan to continue on this.

Regards,
Vignesh



pgsql-hackers by date:

Previous
From: vignesh C
Date:
Subject: Re: Adding CommandID to heap xlog records
Next
From: vignesh C
Date:
Subject: Re: xml2: add test for coverage