Re: Add LZ4 compression in pg_dump - Mailing list pgsql-hackers
From | Tomas Vondra |
---|---|
Subject | Re: Add LZ4 compression in pg_dump |
Date | |
Msg-id | ce49a4f6-f7cc-28d7-3761-ddee7ef732af@enterprisedb.com Whole thread Raw |
In response to | Re: Add LZ4 compression in pg_dump (Tomas Vondra <tomas.vondra@enterprisedb.com>) |
Responses |
Re: Add LZ4 compression in pg_dump
Re: Add LZ4 compression in pg_dump |
List | pgsql-hackers |
On 1/19/23 18:55, Tomas Vondra wrote: > Hi, > > On 1/19/23 17:42, gkokolatos@pm.me wrote: >> >> ... >> >> Agreed. It was initially submitted as one patch. Then it was requested to be >> split up in two parts, one to expand the use of the existing API and one to >> replace with the new interface. Unfortunately the expansion of usage of the >> existing API requires some tweaking, but that is not a very good reason for >> the current patch set. I should have done a better job there. >> >> Please find v22 attach which combines back 0001 and 0002. It is missing the >> documentation that was discussed above as I wanted to give a quick feedback. >> Let me know if you think that the combined version is the one to move forward >> with. >> > > Thanks, I'll take a look. > After taking a look and thinking about it a bit more, I think we should keep the two parts separate. I think Michael (or whoever proposed) the split was right, it makes the patches easier to grok. Sorry for the noise, hopefully we can just revert to the last version. While reading the thread, I also noticed this: > By the way, I think that this 0002 should drop all the default clauses > in the switches for the compression method so as we'd catch any > missing code paths with compiler warnings if a new compression method > is added in the future. Now I realize why there were "not yet implemented" errors for lz4/zstd in all the switches, and why after removing them you had to add a default branch. We DON'T want a default branch, because the idea is that after adding a new compression algorithm, we get warnings about switches not handling it correctly. So I guess we should walk back this change too :-( It's probably easier to go back to v20 from January 16, and redo the couple remaining things I commented on. FWIW I think this is a hint that adding LZ4/ZSTD options, in 5e73a6048, but without implementation, was not a great idea. It mostly defeats the idea of getting the compiler warnings - all the places already handle PG_COMPRESSION_LZ4/PG_COMPRESSION_ZSTD by throwing a pg_fatal. So you'd have to grep for the options, inspect all the places or something like that anyway. The warnings would only work for entirely new methods. However, I now also realize the compressor API in 0002 replaces all of this with calls to a generic API callback, so trying to improve this was pretty silly from me. Please, fix the couple remaining details in v20, add the docs for the callbacks, and I'll try to polish it and get it committed. regards -- Tomas Vondra EnterpriseDB: http://www.enterprisedb.com The Enterprise PostgreSQL Company
pgsql-hackers by date: