Workflow
Google TPUv7
icon
Search documents
中金 | AI进化论(18):谷歌引领ASICs自研加速,异于GPGPU架构的硬件价值再定义
中金点睛· 2025-12-08 23:37
Core Viewpoint - The launch of Google TPUv7 signifies a shift towards self-developed ASIC clusters, enhancing hardware value through heterogeneity and restructuring, which is expected to accelerate the growth of the AI computing hardware market, including PCB, liquid cooling, and power supply components, with projected market sizes reaching $21.65 billion, $20.18 billion, and $18.39 billion by 2027 respectively [2][4]. Group 1: TPU Architecture Evolution - Google has evolved its TPU architecture over the past decade, transitioning from TPU v1, a pure inference co-processor, to TPU v7, which features significant advancements such as dual-chiplet packaging and enhanced linear acceleration in large-scale clusters [3][10]. - The TPU v7 architecture includes 16 standardized compute trays, each housing 4 TPU chips, and utilizes a 100% liquid cooling system, supporting up to 9216 TPU chips in a single cluster [3][12]. Group 2: Market Size Projections - The AI PCB market is projected to reach $21.65 billion by 2027, driven by increased demand from Google’s TPU shipments and product iterations [4][38]. - The AI liquid cooling market is expected to grow to $20.18 billion by 2027, as the TDP of chips increases, necessitating more efficient cooling solutions [4][39]. - The AI power supply chip market is forecasted to reach $18.39 billion by 2027, influenced by the power architecture changes introduced with TPUv7 [4][41]. Group 3: Component Value Breakdown - The value breakdown for TPU v7 components includes approximately $54,400 for TPU, $4,000 for PCB, $7,000 for liquid cooling, and $7,100 for power supply, totaling around $73,000 per TPU unit [4][12]. - The projected market sizes for AI PCB, liquid cooling, and power supply chips by 2027 are $36.9 billion, $60.6 billion, and $31 billion respectively, based on Google’s procurement estimates [4][41]. Group 4: Technological Innovations - TPU v7 introduces a dual-chiplet design that integrates two logic cores with eight HBM3e memory stacks, achieving a memory bandwidth of 7.4 TB/s and a peak performance of 4614 TFLOPS [10][33]. - The TPU v7 architecture employs a high-voltage direct current (HVDC) power supply system, which significantly reduces transmission losses and enhances efficiency [12][30]. Group 5: Cooling and Power Supply Innovations - The TPU v7 utilizes a fully liquid-cooled architecture with advanced flow control systems to manage heat dissipation effectively, ensuring stable operating temperatures [25][26]. - The power supply architecture for TPU v7 is designed to handle over 100 kW per cabinet, utilizing a distributed architecture that minimizes current transmission losses [30][32].
中金:谷歌引领ASICs自研加速 异于GPGPU架构的硬件价值再定义
Zhi Tong Cai Jing· 2025-12-08 08:08
Core Insights - The launch of Google's TPUv7 marks a significant advancement in ASIC clusters, moving away from traditional GPGPU architectures, which is expected to reshape the hardware landscape and accelerate the growth of AI computing hardware markets such as PCB, liquid cooling, and power supply [1] Group 1: Google TPU Evolution - Google has evolved its TPU architecture over the past decade, transitioning from TPU v1 in 2016 to TPUv7, which features nearly 10,000 chip clusters and incorporates OCS optical switching architecture and HBM high-bandwidth memory [2] - The TPUv7 chip has made significant improvements in dual-chip packaging architecture, enhancing linear acceleration in large-scale clusters [2] Group 2: TPUv7 Hardware Changes - The TPUv7 tray architecture includes 16 standardized computing trays, each housing 4 TPU chips; the power architecture utilizes a +/-400V high-voltage direct current (HVDC) solution; and the cooling system employs a 100% liquid cooling architecture with a large cold plate design covering 4 TPU chips and VRM [3] - The maximum cluster size supports interconnection of 144 racks, totaling 9,216 TPU chips [3] Group 3: Market Projections - The breakdown of the TPUv7 cabinet solution indicates the value of TPU, PCB, liquid cooling, power supply, and cables at approximately $54,400, $4,000, $7,000, $7,100, and $400 respectively, totaling around $730,000 [3] - As TPU shipments increase and product structure iterations drive demand, the AI PCB, liquid cooling, and power supply chip markets are projected to grow significantly, with expected market sizes of $36.9 billion, $60.6 billion, and $31 billion respectively by 2027 based on Google's procurement standards; overall GPU and ASICs demand is projected to reach $216.5 billion, $201.8 billion, and $183.9 billion for these markets by 2027 [3]