内存内计算(PIM)

Search documents
《GenAI的内存解决方案》系列综合报告
Counterpoint Research· 2025-04-03 02:59
Group 1: Core Insights - GenAI applications require high-speed, high-bandwidth, and low-latency memory for real-time data processing, making fast data access critical for decision-making and predictions [2] - The competition landscape in memory technology is evolving, with challenges in memory design and emerging trends shaping the future of high-performance computing [4][6] - Custom HBM (High Bandwidth Memory) is becoming essential for AI systems, with significant growth expected as companies like NVIDIA, Amazon, and Microsoft drive its development [26][28] Group 2: Competitive Landscape - Samsung is lagging in HBM due to conservative actions in advanced testing and packaging, focusing too much on cost while failing to meet customer demands for heat dissipation and power consumption [7] - SK Hynix is leading the market by addressing NVIDIA's power and thermal constraints through innovative memory unit designs and backend processing [7][8] - Micron is entering the HBM market later than competitors, planning to launch HBM3e by 2025, while adopting proven bonding equipment and internal voltage conversion technologies [7][8] Group 3: China's Influence - China's influence in the storage market is expected to grow, depending on the new demand environment shaped by GenAI, technological changes, and U.S.-China policies [9] - By 2024, China's DRAM manufacturer CXMT is projected to account for 13% of global capacity, 6% of shipments, and 3.7% of revenue, with potential growth to match Micron's capacity by 2025 [12] - The Chinese semiconductor industry is working towards domestic supply chains for HBM and DRAM, but faces challenges due to U.S. regulations on advanced equipment [12][18] Group 4: Smartphone Integration - The integration of GenAI with smartphones is a significant development, requiring transformative memory solutions and altering the competitive landscape [11] - Samsung plans to improve HBM3e by Q1 2025, potentially increasing its HBM shipment from 8-9 billion gigabits to 11-12 billion gigabits [11] - China aims for domestic production of HBM3 by 2025, with a focus on self-sufficiency in GPU manufacturing and related technologies [11] Group 5: Future Trends and Innovations - The future of memory solutions will focus on balancing bandwidth, capacity, power consumption, and cost, with ARM's recent strategic adjustments influencing configurations [22] - Innovations like Processing In Memory (PIM) and Wide I/O are expected to enhance performance in high-end smartphones and other applications, although their adoption timelines vary [15][22] - The custom HBM market is projected to grow significantly, with estimates suggesting it could account for 30-40% of the overall HBM market by 2030 [29]