Re: reduce size of logs stored by buildfarm - Mailing list pgsql-hackers

From Jacob Champion
Subject Re: reduce size of logs stored by buildfarm
Date
Msg-id CAOYmi+mF9Mkwzd2cn+mW8JKx-fscJO_VPWchCW6shkZvC-OjYQ@mail.gmail.com
Whole thread Raw
In response to reduce size of logs stored by buildfarm  (Álvaro Herrera <alvherre@kurilemu.de>)
Responses Re: reduce size of logs stored by buildfarm
List pgsql-hackers
On Tue, Nov 25, 2025 at 5:30 AM Álvaro Herrera <alvherre@kurilemu.de> wrote:
> I also noticed that an oauth test file contains a couple MBs of a
> gigantic string of just 'x'.  I suppose that will compress well (with
> gzip at least, the 2 MB file becomes 8 kB).  Still, it's kinda
> ridiculous and useless to bloat a 67 kB file to 2 MB that way.

Sorry about that.

> 0003 does that by simply cutting the string short at 10k, which reduces
> the size of the log from 2 MB to some 86 kB.  Maybe there are better
> ways to deal with this?  Jacob?

Only thing I don't like about this is that the JSON you need for
debugging might be after the useless padding. Attached is a patch that
does things more surgically, tested against Python 3.6, and I'm
running it through the CI now.

Thanks,
--Jacob

Attachment

pgsql-hackers by date:

Previous
From: Álvaro Herrera
Date:
Subject: Re: reduce size of logs stored by buildfarm
Next
From: Álvaro Herrera
Date:
Subject: Re: reduce size of logs stored by buildfarm