Re: log chunking broken with large queries under load - Mailing list pgsql-hackers

From Tom Lane
Subject Re: log chunking broken with large queries under load
Date
Msg-id 6290.1333382414@sss.pgh.pa.us
Whole thread Raw
In response to Re: log chunking broken with large queries under load  (Andrew Dunstan <andrew@dunslane.net>)
Responses Re: log chunking broken with large queries under load  (Andrew Dunstan <andrew@dunslane.net>)
List pgsql-hackers
Andrew Dunstan <andrew@dunslane.net> writes:
> On 04/01/2012 06:34 PM, Andrew Dunstan wrote:
>> Some of my PostgreSQL Experts colleagues have been complaining to me 
>> that servers under load with very large queries cause CSV log files 
>> that are corrupted,

> We could just increase CHUNK_SLOTS in syslogger.c, but I opted instead 
> to stripe the slots with a two dimensional array, so we didn't have to 
> search a larger number of slots for any given message. See the attached 
> patch.

This seems like it isn't actually fixing the problem, only pushing out
the onset of trouble a bit.  Should we not replace the fixed-size array
with a dynamic data structure?
        regards, tom lane


pgsql-hackers by date:

Previous
From: Andrew Dunstan
Date:
Subject: Re: log chunking broken with large queries under load
Next
From: Jay Levitt
Date:
Subject: Re: Switching to Homebrew as recommended Mac install? / apology