Hardware advice - Mailing list pgsql-general

Hi all,

At work we are in the process of setting up a data-warehouse using PG 10. I'm looking for a suitable server, but I
hardlyknow anything about server-grade hardware. 

Hence, we're looking for some advice, preferably with some opportunity to discuss our situation and possibly things we
didnot take into account etc. A face to talk to would be appreciated. 
Who provides that in or near the eastern border of the Netherlands?

More details:

We're planning to deploy on bare-metal hardware, with a fallback server with similar or lesser specs for emergencies
andupgrades and perhaps some (read-only) load balancing of different kinds of loads. 

The server will be accessed for reporting and ETL (or ELT) mostly. Both reporting servers (test/devel and production)
areconfigured for at most 40 agents, so that's max 40 connections each to the warehouse for now. So far, we haven't
reachedthat number in real loads, but reports are requested ~40,000 times a month (we measure HTTP requests minus
staticcontent). 

We will also be doing ETL of (very) remote (SAP) tables to the warehouse server; in what we got so far in our limited
testenvironment we have tables of over 30GB, most of which is from the last 4 to 5 years. 

The biggy though is that we also plan to store factory process measurements on this server (temperatures, pressures,
etc.at 5s intervals). 
Part of one factory has already been writing that data to a different server, but that's already 4.3 billion records
(140GB)for about a year of measuring and that's not even half of the factory. We will be required to retain 10-15 years
ofdata from several factories (on the short term, at least 2). The expectancy is that this will grow to ~15TB for our
factoryalone. 

We also want to keep our options for growth of this data warehouse open. There are some lab databases, for example,
thatcurrently exist as two separate brand database servers (with different major versions of the lab software, so there
aredesign differences as well), that aren't exactly small either. 

I have been drooling over those shiny new AMD Epyc processors, which look certainly adequate with a truckload of memory
anda good RAID-10 array and some SSD(s) for the WAL, but it's really hard to figure out how many cores and memory we
need.Sure, 2 7601's at 64 cores and 4TB of memory (if that's even for sale) would probably do the trick, but even I
thinkthat might be going a little overboard ;) 

Oh yeah, apparently we're married to HP or something… At least, IT management told me to look at their offerings.

Regards,

Alban Hertroys
--
If you can't see the forest for the trees,
cut the trees and you'll find there is no forest.