A featured contribution from Leadership Perspectives, a curated forum for enterprise technology leaders, nominated by our subscribers and vetted by the CIOApplications Editorial Board.
AURECON
Future-Proofing Data Center Designs With A Dash Of Innovation
To understand how this shift is happening, it is worth exploring the evolution of the compute loads over time to bring us to the current day.
From the earliest days of the mainframe,traditional data centers relied on defined physical infrastructure dedicated for a specific purpose with expansion of workloads generally requiring a matched expansion in physical hardware. If you wanted more compute, storage or networking, you bought more hardware, leading to a proliferation of data center area but– by today’s standards – it was exceedingly low utilization as invariably not all hardware was running at anywhere near full capacity all the time.
Lots of things have progressed from those physically restrictive days to now, but in short, first we saw virtualization in the early 2000s this was refined and turbo charged to bring us to the software defined data center of today. This ushered in an era where logical computing was not restricted to a physical piece of hardware but one could move a logical process around the data center in ever more elaborate ways.
These innovations led to significant increases in raw computing per rack. It did not generally, however, translate into huge gains in power and cooling requirements in the facility. This is largely due to the fact that historically load provisioning has been done using a very risk based approach. If you had, in the early days, 10 racks with a peak power draw of 5kW each, you’d likely provision for 50kW of power provision (with a little extra for luck). The fact that each of those servers was almost never at 5kW, didn’t feature into the consciousness of designers because there was simply no way of knowing what the loads would be, or when. On that one day a year when all servers were running in anger, you had to have that power available.
Virtualization made the data centers more dense; more of the time, more of the servers were closer to their maximum. But that maximum didn’t fundamentally change. So you still provisioned your 50kW for your 10 racks, you just used more of it for most of the time.
Yes, density has increased. With modern hardware the power draw has increased but generally speaking for all the vast increases in raw compute power for a given rack, the power and cooling requirements have not seen a large step change as a general rule (there are exceptions today just as there were in the mainframe days). Look around and you’d still generally find data centers provisioned for 6-10kW per rack.
Something else which remained constant was the fact that CPUs did all of the real work. These little chips are incredibly good at processing structured data – data in rows and columns – which is how the world ordered it’s data until recently.
Today, much of the data is unstructured, coming from sources as diverse as a plethora of IOT devices to AI analysis of our sleep patterns to Bitcoin mining. The benefit of this wealth of information is that all of this huge data (both structured and unstructured) hold the key to helping organizations better understand their customers, follow patterns of behaviour to predict future actions, uncover breakthroughs to cure diseases, perform engineering simulations, and make communities safer, among a myriad of other things.
To harness this plethora of data, artificial intelligence and machine learning has emerged, which uses algorithms to train data to find patterns. The problem is, traditional CPUs cannot adequately handle the bulk processing required for this complex series of datasets, which is why GPUs are proliferating.
GPU-based servers are fast becoming as necessary to effectively process data for artificial intelligence (especially for deep learning algorithms). While CPU’s do have the capabilities to process tons of unstructured dataGPUs can do what a CPU takes days or weeks to do in a matter of minutes. Click on any tech news channel and you’ll hear about GPU shortages owing to blockchain miners buying up the world’s supply. This is because GPUs can uniquely solve these complex mining challenges.
For the data center, with increased requirements for AI-processing, GPUs are becoming ubiquitous. This, in turn, is seeing a requirement for both increased power and cooling, but more directed cooling A GPU can draw several times more power than a CPU, and has a much higher thermal design point (TDP). This means that it gets hotter in one spot so needs more directed cooling; take a look at any consumer grade GPU and note massive cooling fans (and often water cooling blocks).
The challenge which must be considered by the data center designers is that these hardware accelerators have a higher thermal design point (TDP) than a traditional CPU with individual units being regularly utilised now which independently need over 1kW of cooling. In short, adding a GPU alongside their traditional CPU can triple the density requirement of the server; in these deployments 30kW/rack is not uncommon, nor is the fact that direct-to-chip cooling is becoming almost essential.
The interesting thing about all this is that the way we provision for the data center power and cooling is fundamentally changing with the data center designers now taking a much greater interest not just in the total loads, but the types of loads.
My advice to anyone looking at a new data center strategy? Get your IT teams in the room with the design teams and strategists early in the process; they need – more than ever – to understand the IT stack.
Unless it’s with your Friday fish supper, no one likes hot chips
Something else which remained constant was the fact that CPUs did all of the real work. These little chips are incredibly good at processing structured data – data in rows and columns – which is how the world ordered it’s data until recently.
Today, much of the data is unstructured, coming from sources as diverse as a plethora of IOT devices to AI analysis of our sleep patterns to Bitcoin mining. The benefit of this wealth of information is that all of this huge data (both structured and unstructured) hold the key to helping organizations better understand their customers, follow patterns of behaviour to predict future actions, uncover breakthroughs to cure diseases, perform engineering simulations, and make communities safer, among a myriad of other things.
To harness this plethora of data, artificial intelligence and machine learning has emerged, which uses algorithms to train data to find patterns. The problem is, traditional CPUs cannot adequately handle the bulk processing required for this complex series of datasets, which is why GPUs are proliferating.
Get your IT teams in the room with the design teams and strategists early in the process; they need – more than ever – to understand the IT stack
GPU-based servers are fast becoming as necessary to effectively process data for artificial intelligence (especially for deep learning algorithms). While CPU’s do have the capabilities to process tons of unstructured dataGPUs can do what a CPU takes days or weeks to do in a matter of minutes. Click on any tech news channel and you’ll hear about GPU shortages owing to blockchain miners buying up the world’s supply. This is because GPUs can uniquely solve these complex mining challenges.
For the data center, with increased requirements for AI-processing, GPUs are becoming ubiquitous. This, in turn, is seeing a requirement for both increased power and cooling, but more directed cooling A GPU can draw several times more power than a CPU, and has a much higher thermal design point (TDP). This means that it gets hotter in one spot so needs more directed cooling; take a look at any consumer grade GPU and note massive cooling fans (and often water cooling blocks).
The challenge which must be considered by the data center designers is that these hardware accelerators have a higher thermal design point (TDP) than a traditional CPU with individual units being regularly utilised now which independently need over 1kW of cooling. In short, adding a GPU alongside their traditional CPU can triple the density requirement of the server; in these deployments 30kW/rack is not uncommon, nor is the fact that direct-to-chip cooling is becoming almost essential.
The interesting thing about all this is that the way we provision for the data center power and cooling is fundamentally changing with the data center designers now taking a much greater interest not just in the total loads, but the types of loads.
My advice to anyone looking at a new data center strategy? Get your IT teams in the room with the design teams and strategists early in the process; they need – more than ever – to understand the IT stack.
Unless it’s with your Friday fish supper, no one likes hot chips
The articles from these contributors are based on their personal expertise and viewpoints, and do not necessarily reflect the opinions of their employers or affiliated organizations.
