Re: Backing up 16TB of data (was Re: > 16TB worth of - Mailing list pgsql-general

From Jan Wieck
Subject Re: Backing up 16TB of data (was Re: > 16TB worth of
Date
Msg-id 3EA9C587.7F1EE472@Yahoo.com
Whole thread Raw
In response to Re: Backing up 16TB of data (was Re: > 16TB worth of  ("scott.marlowe" <scott.marlowe@ihs.com>)
Responses Re: Backing up 16TB of data (was Re: > 16TB worth of  (Lincoln Yeoh <lyeoh@pop.jaring.my>)
List pgsql-general
"scott.marlowe" wrote:
>
> On Fri, 25 Apr 2003, Jan Wieck wrote:
>
> > Ron Johnson wrote:
> > >
> > > On Mon, 2003-04-21 at 13:23, Jeremiah Jahn wrote:
> > > > I have a system that will store about 2TB+ of images per year in a PG
> > > > database. Linux unfortunatly has the 16TB limit for 32bit systems. Not
> > > > really sure what should be done here. Would life better to not store the
> > > > images as BLOBS, and instead come up with some complicated way to only
> > > > store the location in the database, or is there someway to have postgres
> > > > handle this somehow? What are other people out there doing about this
> > > > sort of thing?
> > >
> > > Now that the hard disk and file system issues have been hashed around,
> > > have you thought about how you are going to back up this much data?
> >
> > Legato had shown a couple years ago already that Networker can backup
> > more than a Terabyte per hour. They used an RS6000 with over 100 disks
> > and 36 DLT 7000 drives on 16 controllers if I recall correctly ... not
> > your average backup solution but it's possible. But I doubt one can
> > configure something like this with x86 hardware.
>
> I'm sure you could, but it might well involve 12 PII-350's running a trio
> of DLTs each, with a RAID array for caching. :-)

How many bits per second is a Terabyte per hour? One TB is 8TBit (plus
protocol overhead and so on and so forth but let's ignore that for this
discussion), we're talking about at least 8,000 GBit ... and one hour
has 3.6 Kiloseconds ... making more than 2 GBit per second ... so there
are 3 of these PC's per Gigabit segment and the DB server has a 4x
Gigabit card just for that, cool!

Of course, assuming we want to backup the total 24 Terabyte he has in
2-3 years in less than a day, if we have a month to take a backup we can
save some money on the backup solution.


Jan

--
#======================================================================#
# It's easier to get forgiveness for being wrong than for being right. #
# Let's break this rule - forgive me.                                  #
#================================================== JanWieck@Yahoo.com #


pgsql-general by date:

Previous
From: nolan@celery.tssi.com
Date:
Subject: Re: Backing up 16TB of data (was Re: > 16TB worth of
Next
From: Eric Frazier
Date:
Subject: Re: Are we losing momentum?