Re: benchmark results comparing versions 15.2 and 16 - Mailing list pgsql-hackers

From MARK CALLAGHAN
Subject Re: benchmark results comparing versions 15.2 and 16
Date
Msg-id CAFbpF8NyOiw=aJ5RsRTeUJNKf=erqCEvYPENeSDMDN8YsuJm5A@mail.gmail.com
Whole thread Raw
In response to Re: benchmark results comparing versions 15.2 and 16  (Andres Freund <andres@anarazel.de>)
Responses Re: benchmark results comparing versions 15.2 and 16
List pgsql-hackers
On Fri, May 19, 2023 at 4:04 PM Andres Freund <andres@anarazel.de> wrote:
With "yet to see any significant changes" do you mean that the runs are
comparable with earlier runs, showing the same regression? Or that the
regression vanished? Or ...?

I mean that I might be chasing noise and the mean+stddev for throughput in version 16 pre-beta so far appears to be similar to 15.2. When I ran the insert benchmark a few times, I focused on the cases where 16 pre-beta was worse than 15.2 while ignoring the cases where it was better. Big regressions are easy to document, small ones not so much.

Regardless, I am repeating tests from both the insert benchmark and sysbench for version 16 (pre-beta, and soon beta1).

pgsql-hackers by date:

Previous
From: Stephen Frost
Date:
Subject: Re: Adding SHOW CREATE TABLE
Next
From: Bruce Momjian
Date:
Subject: Re: PG 16 draft release notes ready