Core Insights - The article highlights the evolving role of CPUs in AI computing, indicating that as the AI industry transitions to agent-driven reinforcement learning, CPUs are becoming the new bottleneck in computational power, overshadowing GPUs [4][6] - Recent research shows that in the complete agent execution chain, CPU processing can account for up to 90.6% of end-to-end latency, particularly in high-concurrency scenarios where CPU latency can increase from 2.9 seconds to over 6.3 seconds [4] - NVIDIA's investment of $2 billion in CoreWeave and the introduction of the Vera CPU, designed for agentic reasoning, signifies a strategic shift towards enhancing CPU capabilities in AI applications [4][5] CPU Demand Drivers - The increased demand for CPUs is driven by application scheduling pressures, high concurrency tool calls becoming bottlenecks, and the rigid overhead from sandbox isolation [6] - The shift from pure dialogue to task execution in AI has led to a rise in conditional operations, which are better suited for CPUs than GPUs, thus increasing CPU load [6][7] Market Dynamics - Major cloud service providers have significantly increased their demand for server CPUs, leading Intel and AMD to sell out their server CPU capacity for 2026 and plan price hikes of 10-15% [5] - Intel's CEO expressed concerns about not being able to fully meet the semiconductor demand driven by the AI era, indicating a supply-demand imbalance [5] Architectural Evolution - The architecture of AI computing is evolving into a closed-loop structure of perception, planning, tool invocation, and reasoning, with CPUs playing a crucial role in task scheduling and information retrieval [7] - The use of KV CacheOffload technology to migrate data to CPU memory is becoming a mainstream choice, allowing CPUs with large DDR5/LPDDR5 capacities to efficiently handle KV Cache and parameters [7] Investment Opportunities - The upgrade cycle in large-scale data centers is creating significant replacement demand for CPU architectures, with a projected 25% growth in server CPU shipments by 2026 [8] - The server CPU segment is positioned to benefit from the AI computing and data center upgrade trends, entering a phase of stock upgrades, domestic replacements, and model iterations, which may lead to a revaluation of its market potential [8]
CPU何以站上“算力C位”?