Re: making relfilenodes 56 bits - Mailing list pgsql-hackers

From Dilip Kumar
Subject Re: making relfilenodes 56 bits
Date
Msg-id CAFiTN-uPcJ+-b228TVzVneW+2nZ09edgRU5D5v5Qmj-8g8AZag@mail.gmail.com
Whole thread Raw
In response to Re: making relfilenodes 56 bits  (Dilip Kumar <dilipbalaut@gmail.com>)
Responses Re: making relfilenodes 56 bits
Re: making relfilenodes 56 bits
Re: making relfilenodes 56 bits
Re: making relfilenodes 56 bits
List pgsql-hackers
On Mon, Jul 18, 2022 at 4:51 PM Dilip Kumar <dilipbalaut@gmail.com> wrote:
>
> I was doing some more testing by setting the FirstNormalRelFileNumber
> to a high value(more than 32 bits) I have noticed a couple of problems
> there e.g. relpath is still using OIDCHARS macro which says max
> relfilenumber file name can be only 10 character long which is no
> longer true.  So there we need to change this value to 20 and also
> need to carefully rename the macros and other variable names used for
> this purpose.
>
> Similarly there was some issue in macro in buf_internal.h while
> fetching the relfilenumber.  So I will relook into all those issues
> and repost the patch soon.

I have fixed these existing issues and there was also some issue in
pg_dump.c which was creating problems in upgrading to the same version
while using a higher range of the relfilenumber.

There was also an issue where the user table from the old cluster's
relfilenode could conflict with the system table of the new cluster.
As a solution currently for system table object (while creating
storage first time) we are keeping the low range of relfilenumber,
basically we are using the same relfilenumber as OID so that during
upgrade the normal user table from the old cluster will not conflict
with the system tables in the new cluster.  But with this solution
Robert told me (in off list chat) a problem that in future if we want
to make relfilenumber completely unique within a cluster by
implementing the CREATEDB differently then we can not do that as we
have created fixed relfilenodes for the system tables.

I am not sure what exactly we can do to avoid that because even if we
do something  to avoid that in the new cluster the old cluster might
be already using the non-unique relfilenode so after upgrading the new
cluster will also get those non-unique relfilenode.

-- 
Regards,
Dilip Kumar
EnterpriseDB: http://www.enterprisedb.com

Attachment

pgsql-hackers by date:

Previous
From: Amul Sul
Date:
Subject: GetStandbyFlushRecPtr() : OUT param is not optional like elsewhere.
Next
From: Aleksander Alekseev
Date:
Subject: Re: GetStandbyFlushRecPtr() : OUT param is not optional like elsewhere.