RE: Calculating how much redo log space has been used - Mailing list pgsql-performance

From Reza Taheri
Subject RE: Calculating how much redo log space has been used
Date
Msg-id DM6PR05MB439491644AE6B1395EE6BC59DE3F0@DM6PR05MB4394.namprd05.prod.outlook.com
Whole thread Raw
In response to Re: Calculating how much redo log space has been used  (Andres Freund <andres@anarazel.de>)
List pgsql-performance
> -----Original Message-----
> From: Andres Freund [mailto:andres@anarazel.de]
> Sent: Tuesday, August 14, 2018 12:31 PM
> To: Reza Taheri <rtaheri@vmware.com>
> Cc: pgsql-performance@postgresql.org
> Subject: Re: Calculating how much redo log space has been used
>
> Hi,
>
> On 2018-08-14 18:51:34 +0000, Reza Taheri wrote:
> > Also, it looks like the full_page_writes parameter is the only thing
> > that can help reduce the log usage size
>
> There's also wal_compression.
>
>
> > Another requirement is a very short, 6-minute checkpoint time, which
> > means we will likely write the full page very often. Yes, my hands are
> > tied!
>
> Why is that a requirement / how is specifically phrased? Is it a bounded
> recovery time?
>
> Greetings,
>
> Andres Freund

Hi Andres,
Good to know about wal_compression. It gives us a good reason to upgrade to 9.5 to get that feature.

The need for a 6-minute checkpoint came from this requirement in the benchmark specification:

the database contents (excluding the transaction log) stored on Durable Media cannot be more than 12 minutes older than
anyCommitted state of the database. 
Comment: This may mean that Database Management Systems implementing traditional checkpoint algorithms may need to
performcheckpoints twice as frequently (i.e. every 6 minutes) in order to guarantee that the 12-minute requirement is
met.

But in any case, I now realize that I was going into the weeds, looking at the wrong thing. My original issue was
figuringout how quickly we churn through checkpoint segment files, and had been looking at the checkpoint stats in
pgstatspackto figure that out. But that's the wrong place to look. I don't think there is anything in the pgstatspack
outputthat can give me that information. I can tell by looking at the timestamps of the checkpoint segment files, but I
washoping to find something that gets logged in pg_log/postgresql-*log and tells me when we switch to a new log 

Thanks,
Reza


pgsql-performance by date:

Previous
From: Daniel Blanch Bataller
Date:
Subject: Re: increase insert into local table from remote oracle tablepreformance
Next
From: legrand legrand
Date:
Subject: Re: Fwd: increase insert into local table from remote oracle tablepreformance