Re: log_filename_prefix --> log_filename + strftime() - Mailing list pgsql-patches

From Ed L.
Subject Re: log_filename_prefix --> log_filename + strftime()
Date
Msg-id 200408271634.07428.pgsql@bluepolka.net
Whole thread Raw
In response to Re: log_filename_prefix --> log_filename + strftime()  (Tom Lane <tgl@sss.pgh.pa.us>)
Responses Re: log_filename_prefix --> log_filename + strftime()  ("Ed L." <pgsql@bluepolka.net>)
List pgsql-patches
On Friday August 27 2004 3:49, Tom Lane wrote:
>
> A potential problem is what about size-driven rotation?  If the hourly
> output exceeds log_rotation_size then you'd truncate and rewrite the
> current file, which is just exactly not what you want :-(.  You could
> say that truncation occurs only at time-driven, not size-driven
> rotations, but that would effectively amount to saying that size-driven
> rotation is disabled, which I don't think I like ...

> One other thing I've been thinking of suggesting is that the
> next-rotation-target-time be rounded to an exact multiple of
> log_rotation_age.  So for example if you set log_rotation_age = 60
> minutes then rotations will happen at the top of the hour no matter
> when the postmaster was started.  The simplistic approach of doing
> this on the time_t value would mean that, say, age = 24*60 would give
> you rotations occurring at GMT midnight not local midnight, which isn't
> perfect but I'd say good enough.  Again though, the interaction with
> size-driven rotation might need more thought.

Apache's rotatelogs works this way, and includes a UTC offset option, to
allow rotations at local midnight.

> Possibly you could fix the first issue if you did all this to the code
> and then used, say, log_filename "postgresql_%H:%M.log" with 60-minute
> rotation.  You'd normally get only logfiles named after the top of the
> hour, but in an hour with unusually heavy log output you might get some
> additional files with intermediate %M values.  Course that puts you back
> to needing a cron daemon to clean those up ...

Not that elegant, but pretty reasonable, I think.  In the normal case of
logfiles under the maximum size, everything is cleaned up.  If you bloat,
you have some clean-up to do, but easy enough with a cron job.  We have
been operating ~40 clusters this way for a couple years now with a modified
Apache rotatelogs (w/truncate option) and a cron to clean-up too-old
logfiles.  It has pretty much eliminated our disk-full crises from DB logs.

Ed


pgsql-patches by date:

Previous
From: Tom Lane
Date:
Subject: Re: log_filename_prefix --> log_filename + strftime()
Next
From: "Greg Sabino Mullane"
Date:
Subject: Show full path name when saving in psql