When we talk about working with GPUs at scale, we usually focus on the software stack, CUDA tuning, or optimizing workloads across NVLink, etc. But if you are an infrastructure SRE managing bare-metal clusters, you quickly run into a much harsher physical reality: Power and Thermals.
As we deploy next-generation AI platforms like Nvidia’s GB200/ 300 NVL72 architectures - the power demands are obliterating traditional infrastructure. Standard server racks are physically hitting a wall. To keep these high-density clusters running without melting down, the industry is rapidly transitioning to the Open Compute Project’s (OCP) Open Rack Version 3 (ORV3) High Power Rack (HPR).
Here is what you need to know about how this architecture feeds and cools modern GPU nodes.
The GPU infrastructure bottleneck
Traditional data center racks rely on a 19-inch width standard with standard 44.45 mm Rack Units (RU). In that legacy model, every individual server chassis houses its own AC-to-DC power supply units (PSUs).
If you try to stuff a modern cluster of high-TDP GPUs into that traditional 19-inch racks, you run into immediate problems:
- Cable chaos: The back of the rack becomes choked with heavy AC power cords, blocking vital airflow.
- Efficiency loss: Converting AC to DC at every single node generates massive heat and power waste.
- Weight limits: GPU nodes are incredibly dense and heavy; standard frames simply aren't structurally rated for them.
How ORV3 changes the game for GPU compute
Developed collaboratively by hyper-scalers like Meta, Google, and Microsoft, the ORV3 standard throws out the legacy playbook to accommodate modern accelerator demands.
Instead of treating the rack like a cabinet for isolated servers, ORV3 treats the entire rack as a single, unified compute machine:
- Native 21-inch bays and Open Units (OU): Provides a wider internal bay (21 inches wide vs. the traditional 19 inches). It replaces RUs with Open Units (OU = 48mm), offering more structural space for complex GPU heat sinks and optimized front-to-rear airflow.
 |
| 21-inch-wide rack |
 |
| 44 OU |
- Centralized 48V DC busbar: Individual server power supplies are completely gone. Instead, 3-phase AC or High Voltage DC (HVDC) enters a centralized power shelf, which converts it to 48V DC. This power is run down a copper busbar mounted at the rear center of the rack.
 |
| 48V busbar |
 |
| Busbar BarKlip connector |
- Power shelves: The ORV3 HPR power shelf acts as a centralized power hub that converts incoming 3-phase AC (from the overhead busways) into 48V DC power distributed via the rear busbar. Housing high-density 5.5 kW Power Supply Units (PSUs), a single 1U power shelf delivers up to 33kW of total output. Racks deploy multiple shelves in N+N or N+1 redundant configurations - complete with integrated Power Monitor Modules (PMM) to supply reliable, cable-free energy to high-TDP GPU clusters.
 |
| AC input overhead busways |
 |
| AC input - Power shelf - DC output - Busbar |
 |
| Power shelf with multiple PSUs inside it |
 |
| GB200 NVL72 ORV3 HPR rack |
- Blind-mate infrastructure: When you slide a heavy GPU compute node into the rack, it connects directly to the 48V DC busbar via copper clips (blind-mate connections). No power cables required. The specialized copper clip/ jaw that physically clamps onto the vertical busbar blade to transmit high-current DC power is called a Busbar BarKlip connector. Blind-mate connectors are widely used for liquid cooling as well in modern high-density data centers. In the OCP ORV3 HPR architecture, the concept of "blind-mating" applies to both power and coolant distribution. Instead of manually hooking up coolant hoses to the back of a server, liquid-cooled blind-mate connectors (often referred to as BMQC or Blind Mate Quick Connectors) allow fluid lines to engage automatically as the compute tray slides into the rack.
 |
| Liquid cooling blind-mate connectors and manifold |
- Heavy duty chassis support: The frame is built to support up to 1400 kg, meaning it won't buckle under a full stack of liquid-cooled accelerators.
The ORV3 HPR specification
While standard ORV3 configurations top out at 18 kW to 36 kW per rack, modern AI workloads easily blow past those thresholds. To keep up with platforms like the Nvidia GB200 pushing rack limits to 140kW and beyond, the OCP community introduced the ORV3 HPR (High Power Rack) variant which is an extension of ORV3.
- Power density: 92 kW to 140 kW+ / rack
- Power shelf capacity: 5.5 kW PSUs (33 kW total per power shelf)
- Cooling architecture: Blind-Mate Direct Liquid Cooling (DLC) Manifolds
To handle massive electrical currents without thermal runaway, the HPR upgrades to a massive 80 kg busbar with deeper tracking and aggressive grounding. More importantly, it addresses the massive heat generated by high-TDP GPUs by integrating blind-mate liquid cooling manifolds right into the chassis. Just like the power clips, the liquid cooling loops engage automatically when the node is seated.
What’s next: The 1-Megawatt sidecar
As we look forward, GPU power requirements show no signs of slowing down. As clusters head toward 1 Megawatt (MW) per rack, the OCP community is already developing Project Mount Diablo. This next step introduces a disaggregated Power Rack Sidecar, moving the massive rectifiers completely outside of the main compute rack so we can fill every square inch of the primary frame with pure, liquid-cooled GPU compute.
Working with GPUs at scale means understanding the infrastructure that keeps them alive. Without open standards like ORV3 HPR solving the physical limitations of power delivery and fluid dynamics, the next leap in AI compute wouldn't even be able to turn on.
References
Hope it was useful. Cheers!
.jpeg)
