Postgres Pro
Downloads
Home   >   mailing lists

Re: pgBackRest for a 50 TB database - Mailing list pgsql-general

From Stephen Frost
Subject Re: pgBackRest for a 50 TB database
Date
Msg-id CAOuzzgqiB9kNpzJNSP1LQpEjHV0A1tL-e+Qx7LB3jkufMPeX+w@mail.gmail.com
Whole thread Raw
In response to Re: pgBackRest for a 50 TB database  (Abhishek Bhola <abhishek.bhola@japannext.co.jp>)
Responses Re: pgBackRest for a 50 TB database
List pgsql-general
Tree view
Greetings,

On Mon, Oct 2, 2023 at 20:08 Abhishek Bhola <abhishek.bhola@japannext.co.jp> wrote:
As said above, I tested pgBackRest on my bigger DB and here are the results.
Server on which this is running has the following config:
Architecture:          x86_64
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                36
On-line CPU(s) list:   0-35
Thread(s) per core:    1
Core(s) per socket:    18
Socket(s):             2
NUMA node(s):          2

Data folder size: 52 TB (has some duplicate files since it is restored from tapes)
Backup is being written on to DELL Storage, mounted on the server.

pgbackrest.conf with following options enabled
repo1-block=y
repo1-bundle=y
start-fast=y

Thanks for sharing!  Did you perhaps consider using zstd for the compression..?  You might find that you get similar compression in less time. 

Thanks.

Stephen

pgsql-general by date:

Previous
From: "Peter J. Holzer"
Date:
Subject: Re: Peer authentication failed ???
Next
From: Douglas Reed
Date:
Subject: Re: Problems starting slave