NVIDIA cools data center hardware with 113-degree water, reducing costs and water use

Introduction to NVIDIA's Cooling Innovation

NVIDIA has introduced a novel cooling technique for its latest AI servers, utilizing coolant at temperatures as high as 45 degrees Celsius (113 degrees Fahrenheit). This contrasts starkly with conventional cooling methods that rely on lower temperature air and water to manage heat in data centers.

How the Cooling System Works

The new system operates on the principle that hot coolant can effectively manage heat from graphics processors, contradicting the traditional view that cold is essential for safe operation. Unlike older systems that expend significant energy on chilling air, the new approach allows outdoor dry coolers to dissipate heat passively.

Economic and Environmental Benefits

NVIDIA's Rubin generation infrastructure effectively reduces the cooling energy needed, with estimates suggesting savings of around 4% in energy costs for every degree the chiller temperature is raised. For large facilities, this could mean savings exceeding $4 million annually. Additionally, the system minimizes water consumption drastically, potentially dropping usage from 2.6 million gallons per megawatt to nearly zero.

Impact on the Data Center Industry

This overhaul of cooling systems in data centers not only addresses operational costs but also significantly lessens environmental impact. By eliminating the need for water towers and reducing energy intensity, NVIDIA's approach challenges decades of cooling strategy in data centers, offering a new perspective on the relationship between temperature and equipment safety.