vineethac.blogspot.com

As AI clusters transition from tens of kilowatts to over 200 kw per rack, traditional server power architectures are hitting their physical ...

The ORV3 HPR Power Shelf is a standardized, ultra-high-density power distribution system designed under the Open Compute Project (OCP) frame...

When we talk about working with GPUs at scale, we usually focus on the software stack, CUDA tuning, or optimizing workloads across NVLink, e...

One of the more common GPU failures encountered in large-scale AI clusters is a situation where the Nvidia driver can no longer communicate ...

Now that we have a foundational understanding of the core utilities used to monitor and manage GPUs, let's dive into the hardware archit...

If you are running large-scale AI training or LLM inference, you already know that managing a GPU cluster is less about "if" thing...

This blog series captures practical learnings from working with GPUs in real‑world environments, with a focus on operations, reliability, an...

During routine diagnostics using dcgmi diag -r 3 test suite, several GPU nodes began failing due to thermal throttling issues. This blog po...

The NVIDIA Data Center GPU Manager (DCGM) is a lightweight agent that performs several functions like GPU behavior monitoring, health and di...