开启存储下一个大机会！韩媒详解黄仁勋“神秘推理上下文内存平台”

Core Insights - NVIDIA's CEO Jensen Huang introduced the "Inference Context Memory Platform" (ICMS) at CES 2026, aimed at addressing the explosive data storage demands during AI inference stages, marking a shift in AI hardware architecture towards efficient context storage [1][2][3] Group 1: ICMS Platform Overview - The ICMS platform is designed to tackle the "KV cache" problem in AI inference, as existing GPU memory and server architectures struggle to meet the growing data demands [1][3] - The platform integrates a new Data Processing Unit (DPU) and massive SSDs to create a large cache pool, aiming to overcome physical limitations in data storage [1][4] Group 2: Market Implications - The introduction of ICMS is expected to benefit major storage manufacturers like Samsung and SK Hynix, as NAND flash is poised to enter a "golden age" similar to that of HBM [2][5] - The demand for enterprise-grade SSDs and NAND flash is anticipated to surge due to the high storage density requirements of ICMS [5][23] Group 3: Technical Specifications - The ICMS platform utilizes the "BlueField-4" DPU, managing a total capacity of 9600TB across 16 SSD racks, significantly surpassing traditional GPU rack capacities [4][16] - Each ICMS rack can achieve a KV cache transfer speed of 200GB per second, addressing network bottlenecks associated with large-capacity SSDs [4][18][19] Group 4: Future Developments - NVIDIA is advancing the "Storage Next" initiative, allowing GPUs to directly access NAND flash, thereby eliminating data transfer bottlenecks [5][23] - SK Hynix is collaborating with NVIDIA to develop a prototype storage product, expected to support 25 million IOPS by the end of the year, with plans to enhance performance to 100 million IOPS by 2027 [5][23]