Nvidia announces liquid cooling system that runs ‘hotter than a hot tub’ — promises to reduce electricity consumption and cut water use by up to 100%, but sustainability challenges remain

AI GPU maker Nvidia just announced a “hotter than a hot tub” liquid cooling system that it says will cut water and electricity use. According to the company, this new solution will run coolant — composed of 75% water and 25% propylene glycol — at 113 degrees F (45 deg C). By comparison, the water in hot tubs hovers at 100 to 104 degrees F (38 to 40 deg C). This feels counterintuitive, but the company says that the “cool” water is enough to handle the heat generated by Nvidia’s Rubin chips and exit the system at 131 degrees F (55 deg C).

Traditional water-cooling methods, especially those that use chillers, often account for nearly 40% of a data center’s power consumption. Aside from that, these systems must often deal with water loss through evaporation. On the other hand, air-cooled facilities also use a considerable amount of electricity, plus they also generate noise pollution. On the other hand, Nvidia says that this new solution uses a lot fewer resources because of its higher base temperature.

Since 113 degrees F is often higher than ambient temperature, data centers can simply rely on outdoor dry coolers to expel the heat to the environment. This is also a closed-loop system; Nvidia claims an up to 100% reduction in water consumption — it’s “filled once and runs closed for the life of the facility.” This solution is most effective in regions with cooler climates, but it should still be effective in warmer areas as long as the ambient temperature is below 113 degrees F.

Data centers that face occasional temperature swings that exceed this limit may still be required to turn on their chillers. Nevertheless, this should still reduce resource consumption, as it only needs to run them a few times per year. Aside from that, this should also allow these systems to run more efficiently, as the chillers don’t have to work as hard to hit the target temperature. It’s estimated that increasing a chiller plant’s target temperature by 1.8 degrees F (1 degree C) would reduce electricity costs by 4%. This means that data centers would save significantly on power consumption if they set their chiller units to the 70 to 75 degrees F (21 to 24 degrees C) that traditional chillers run, according to Vertiv, to the 113 degrees F (45 degrees C) that Nvidia recommends for its Rubin chips.

This solution addresses several of the issues that many local governments raised that led to the delay of more than 75 data centers earlier this year. However, it will likely take time for this cooling system to roll out to new and existing projects, so we expect the delays and resistance to continue until Nvidia’s liquid cooling system gains wider adoption. Furthermore, this only addresses the water use of the data center itself — the GPU servers themselves still require massive amounts of electricity.

Unfortunately, most of the power used by data centers, at least in the United States, comes from fossil fuel power plants, which themselves consume a lot of water. Developments that aren’t tied to the grid and get their electricity from natural gas turbines may not need as much water, but residents are concerned about the pollution they generate. Still, this new cooling solution is a step in the right direction to help make AI more sustainable.