Nvidia to Implement Liquid Cooling in Next-Gen DGX AI Systems

Published 2024-03-11 08:53 by Hilbert Hagedoorn

IT House reported that Nvidia's CEO, Jen-Hsun Huang, has confirmed the incorporation of liquid cooling technology in its forthcoming DGX AI system. At a recent conference, Nvidia announced its move towards liquid cooling for its next-generation DGX AI system, indicating a significant shift in cooling technologies within the data center and AI server domains. The transition to liquid cooling is part of a broader industry trend, with substantial investments being made in the production of liquid cooling equipment. Such systems, while offering enhanced cooling efficiency and the potential for denser server configurations, also present challenges in terms of increased initial costs and complexity in maintenance.

The adoption of liquid cooling technology is expected to allow for tighter server rack configurations due to its superior cooling capabilities. Despite the benefits, the higher setup and operational complexities associated with liquid cooling have slowed its widespread adoption. Notably, other companies, including SMCI (Super Micro Computer) and Intel, have previously announced their ventures into liquid-cooled server solutions, with Nvidia now entering the fray.

Patrick Moorhead, the founder and principal analyst at Moor Insights & Strategy, commented on the evolving landscape of data center cooling solutions. He highlighted the industry's reliance on various optimization strategies, such as node reduction and advanced packaging, to maintain performance within acceptable heat and power thresholds. Moorhead suggests that the sector may need to explore more radical innovations, as conventional cooling solutions, including liquid cooling, might not suffice to meet future demands for performance optimization.

Share this content