RE: [PoC] Non-volatile WAL buffer - Mailing list pgsql-hackers

From tsunakawa.takay@fujitsu.com
Subject RE: [PoC] Non-volatile WAL buffer
Date
Msg-id TYAPR01MB29903EB512A3A47E7099E8E8FEBA9@TYAPR01MB2990.jpnprd01.prod.outlook.com
Whole thread Raw
In response to Re: [PoC] Non-volatile WAL buffer  (Tomas Vondra <tomas.vondra@enterprisedb.com>)
Responses Re: [PoC] Non-volatile WAL buffer  (Takashi Menjo <takashi.menjo@gmail.com>)
List pgsql-hackers
From: Tomas Vondra <tomas.vondra@enterprisedb.com>
> (c) As mentioned before, PMEM behaves differently with concurrent
> access, i.e. it reaches peak throughput with relatively low number of
> threads wroting data, and then the throughput drops quite quickly. I'm
> not sure if the same thing applies to pmem_drain() too - if it does, we
> may need something like we have for insertions, i.e. a handful of locks
> allowing limited number of concurrent inserts.

> I think WALWriteLock itself (i.e. acquiring/releasing it) is not an
> issue - the problem is that writing the WAL to persistent storage itself
> is expensive, and we're waiting to that.
> 
> So it's not clear to me if removing the lock (and allowing multiple
> processes to do pmem_drain concurrently) can actually help, considering
> pmem_drain() should flush writes from other processes anyway.

I may be out of the track, but HPE's benchmark using Oracle 18c, placing the REDO log file on Intel PMEM in App Direct
mode,showed only 27% performance increase compared to even "SAS" SSD.
 

https://h20195.www2.hpe.com/v2/getdocument.aspx?docname=a00074230enw


The just-released Oracle 21c has started support for placing data files on PMEM, eliminating the overhead of buffer
cache. It's interesting that this new feature is categorized in "Manageability", not "Performance and scalability."
 

https://docs.oracle.com/en/database/oracle/oracle-database/21/nfcon/persistent-memory-database-258797846.html


They recommend placing REDO logs on DAX-aware file systems.  I ownder what's behind this.


https://docs.oracle.com/en/database/oracle/oracle-database/21/admin/using-PMEM-db-support.html#GUID-D230B9CF-1845-4833-9BF7-43E9F15B7113

"You can use PMEM Filestore for database datafiles and control files. For performance reasons, Oracle recommends that
youstore redo log files as independent files in a DAX-aware filesystem such as EXT4/XFS."
 


Regards
Takayuki Tsunakawa


pgsql-hackers by date:

Previous
From: "Tang, Haiying"
Date:
Subject: RE: [POC] Fast COPY FROM command for the table with foreign partitions
Next
From: Amit Kapila
Date:
Subject: Re: On login trigger: take three