Core Viewpoint - The article discusses the performance and cost comparison between NVIDIA's H100 and GB200 NVL72 GPUs, highlighting the potential advantages and challenges of the GB200 NVL72 in AI training environments [30][37]. Group 1: Market Predictions and Performance - After the ODM performance announcement, institutions raised the forecast for GB200/300 rack shipments in 2025 from 30,000 to 34,000, with expected shipments of 11,600 in Q3 and 15,700 in Q4 [3]. - Foxconn anticipates a 300% quarter-over-quarter increase in AI rack shipments, projecting a total of 19,500 units for the year, capturing approximately 57% of the market [3]. - By 2026, even with stable production of NVIDIA chips, downstream assemblers could potentially assemble over 60,000 racks due to an estimated 2 million Blackwell chips carried over [3]. Group 2: Cost Analysis - The total capital expenditure (Capex) for H100 servers is approximately $250,866, while for GB200 NVL72, it is around $3,916,824, making GB200 NVL72 about 1.6 to 1.7 times more expensive per GPU [12][13]. - The operational expenditure (Opex) for GB200 NVL72 is slightly higher than H100, primarily due to higher power consumption (1200W vs. 700W) [14][15]. - The total cost of ownership (TCO) for GB200 NVL72 is about 1.6 times that of H100, necessitating at least a 1.6 times performance advantage for GB200 NVL72 to be attractive for AI training [15][30]. Group 3: Reliability and Software Improvements - As of May 2025, GB200 NVL72 has not yet been widely adopted for large-scale training due to software maturity and reliability issues, with H100 and Google TPU remaining the mainstream options [11]. - The reliability of GB200 NVL72 is a significant concern, with early operators facing numerous XID 149 errors, which complicates diagnostics and maintenance [34][36]. - Software optimizations, particularly in the CUDA stack, are expected to enhance GB200 NVL72's performance significantly, but reliability remains a bottleneck [37]. Group 4: Future Outlook - By July 2025, GB200 NVL72's performance/TCO is projected to reach 1.5 times that of H100, with further improvements expected to make it a more favorable option [30][32]. - The GB200 NVL72's architecture allows for faster operations in certain scenarios, such as MoE (Mixture of Experts) models, which could enhance its competitive edge in the market [33].