Re: [HACKERS] Error while copying a large file in pg_rewind - Mailing list pgsql-hackers

From Tom Lane
Subject Re: [HACKERS] Error while copying a large file in pg_rewind
Date
Msg-id 11176.1499110071@sss.pgh.pa.us
Whole thread Raw
In response to Re: [HACKERS] Error while copying a large file in pg_rewind  (Peter Eisentraut <peter.eisentraut@2ndquadrant.com>)
Responses Re: [HACKERS] Error while copying a large file in pg_rewind
List pgsql-hackers
Peter Eisentraut <peter.eisentraut@2ndquadrant.com> writes:
> On 7/3/17 09:53, Tom Lane wrote:
>> Hm.  Before we add a bunch of code to deal with that, are we sure we
>> *want* it to copy such files?  Seems like that's expending a lot of
>> data-transfer work for zero added value --- consider e.g. a server
>> with a bunch of old core files laying about in $PGDATA.  Given that
>> it's already excluded all database-data-containing files, maybe we
>> should just set a cap on the plausible size of auxiliary files.

> It seems kind of lame to fail on large files these days, even if they
> are not often useful in the particular case.

True.  But copying useless data is also lame.

> Also, most of the segment and file sizes are configurable, and we have
> had reports of people venturing into much larger file sizes.

But if I understand the context correctly, we're not transferring relation
data files this way anyway.  If we do transfer WAL files this way, we
could make sure to set the cutoff larger than the WAL segment size.
        regards, tom lane



pgsql-hackers by date:

Previous
From: Peter Eisentraut
Date:
Subject: Re: [HACKERS] Error while copying a large file in pg_rewind
Next
From: Tom Lane
Date:
Subject: Re: [HACKERS] Revisiting NAMEDATALEN