聊一聊液冷

Core Viewpoint - The article discusses the rapid advancements in liquid cooling technology within the semiconductor industry, highlighting the significant power consumption increases of GPUs from Nvidia and AMD, and the evolving design and cost dynamics of liquid cooling systems. Group 1: Liquid Cooling Technology Overview - Nvidia and AMD are leading the application of liquid cooling technology, with Nvidia's B200 chip consuming 1200 watts and the latest B300 chip reaching 1400 watts, while future chips like Rubin are expected to consume up to 3600 watts [2][3] - AMD's GPU power consumption has also surged, with the MI300 series at 700-750 watts, MI325 at 1000 watts, and MI355 at 1400 watts, with the MI375 series projected to reach 1600 watts [2][3] Group 2: Core Component Upgrades - The core components of liquid cooling systems, such as cold plates, quick connectors, and piping, are evolving. The GB200 platform features 45 cold plates at a cost of $600-700 each, while the GB300 has 117 cold plates with a reduced cost of $200-300 each, leading to an overall value increase from $780,000 to $900,000 [4] - The quick connector used in GB200 is the OCP standard UQD04, while GB300 has upgraded to Nvidia's NVQD03, nearly doubling the quantity and increasing the total value to about twice that of GB200 [4] Group 3: Cooling Distribution Units (CDUs) - CDUs are moving towards standardization, with types including embedded, cabinet, and distribution types. The domestic market favors high-power CDUs (1500-2000 watts), while North America and Europe prefer distribution types with capacities of 70 kW and 150 kW, priced around $30,000 to $40,000 [5] - The unique "density stacking" strategy in the domestic GPU market has led to increased demand for liquid cooling solutions, as seen with Huawei's CloudMatrix384 cabinet having a power consumption four times that of Nvidia's NVL72 cabinet [5] Group 4: Market Dynamics and Competition - Domestic data centers are expected to adopt domestic GPU cards extensively, making liquid cooling systems a standard feature. Customization of cold plates and quick connectors is particularly pronounced in the domestic market [7] - Taiwanese manufacturers hold a leading position in the liquid cooling market due to their first-mover advantage, while domestic manufacturers like Invec offer competitive pricing and customization capabilities, with costs for CDU and internal components being 20-30% lower than their Taiwanese counterparts [8] Group 5: Challenges and Future Directions - Current challenges in liquid cooling include issues with dual-sided cold plates, such as increased pressure and deformation, as well as the high cost and environmental concerns associated with immersion cooling fluids [9] - The market is shifting focus towards new mineral oils to optimize flow rates and heat dissipation capabilities, aiming to balance cost and performance [9]