Pages

▼
Sunday, June 14, 2026

Working with GPUs - Part7 - Unable to determine the device handle for GPU

›
One of the more common GPU failures encountered in large-scale AI clusters is a situation where the Nvidia driver can no longer communicate ...
Sunday, May 17, 2026

Working with GPUs - Part6 - H100 SXM5 architecture

›
Now that we have a foundational understanding of the core utilities used to monitor and manage GPUs, let's dive into the hardware archit...
Sunday, April 12, 2026

Working with GPUs - Part5 - XID errors

›
If you are running large-scale AI training or LLM inference, you already know that managing a GPU cluster is less about "if" thing...
Saturday, March 7, 2026

Working with GPUs – A Practical Blog Series

›
This blog series captures practical learnings from working with GPUs in real‑world environments, with a focus on operations, reliability, an...
Saturday, February 28, 2026

Working with GPUs - Part4 - Thermal issues

›
During routine diagnostics using dcgmi diag -r 3 test suite, several GPU nodes began failing due to thermal throttling issues. This blog po...
Sunday, January 25, 2026

Working with GPUs - Part3 - Using dcgmi

›
The NVIDIA Data Center GPU Manager (DCGM) is a lightweight agent that performs several functions like GPU behavior monitoring, health and di...
Saturday, November 15, 2025

Working with GPUs - Part2 - Memory fault indicators

›
AI workloads rely heavily on GPU memory reliability and, memory faults can silently degrade performance long before a GPU outright fails. Un...