Re: [FEATURE REQUEST] Streaming Onlinebackup (MaybeOFFTOPIC) - Mailing list pgsql-hackers

From Zeugswetter Andreas ADI SD
Subject Re: [FEATURE REQUEST] Streaming Onlinebackup (MaybeOFFTOPIC)
Date
Msg-id E1539E0ED7043848906A8FF995BDA57902685F43@m0143.s-mxs.net
Whole thread Raw
In response to Re: [FEATURE REQUEST] Streaming Onlinebackup (MaybeOFFTOPIC)  ("Kevin Grittner" <Kevin.Grittner@wicourts.gov>)
Responses Re: [FEATURE REQUEST] Streaming Onlinebackup (MaybeOFFTOPIC)
Re: [FEATURE REQUEST] Streaming Onlinebackup (MaybeOFFTOPIC)
Re: [FEATURE REQUEST] Streaming Onlinebackup (MaybeOFFTOPIC)
List pgsql-hackers
> > The probably useful next step would be to pass the current length to
the
> > archive_command,
> > so it can write the filled part of the file without the need for a
> > filter.
>
> I can see that helping a lot, but not by writing onto the file on
disk.
> If the file is nearly empty, that would be a lot of disk I/O which
doesn't
> need to happen.

I think you misunderstood what I meant.
The actual archive command is constructed by expanding certain
placeholders.
I am suggesting to add such a placeholder for the size of the filled
part of the log.

A hypothetical example (note suggested %b placeholder for size in
bytes):
archive_command=dd if=%p of=/backup/WAL/%f bs=1 count=%b

This allows to avoid unnecessary io for the backup of partially filled
logs.

Andreas


pgsql-hackers by date:

Previous
From: "Pavel Stehule"
Date:
Subject: Re: proposal casting from XML[] to int[], numeric[], text[]
Next
From: "Nikolay Samokhvalov"
Date:
Subject: Re: proposal casting from XML[] to int[], numeric[], text[]