Nvlink

Search documents
看多国产算力 - 人工智能:从大模型产业视角看AIDC行业发展
2025-09-01 02:01
看多国产算力 - 人工智能:从大模型产业视角看 AIDC 行 业发展 20250831 摘要 国产 AI 芯片在国央企和政府采购中的地位上升,良率提升满足需求,对 海外芯片态度强硬,春节前国产大模型发布将缩短中美差距。 预计 2025 年 Q4 国内云厂商算力缺口显著,字节跳动需求巨大,阿里 加大国产算力投入,日均淘客消耗超 10 万亿次。 国产 AI 芯片产业链中,互联网大订单芯片公司、良率提升制造企业、阿 里平头哥相关业务公司以及散热电源配套企业具投资潜力,海外市场毛 利率高至少 10%。 英伟达网络业务收入创新高,同比增长 98%,环比增长 46%,Spectrum、以太坊、Infiniband 及 Nvlink 表现强劲,机柜级 scale up 需求剧增。 GPU 通信带宽提升导致交换芯片和交换机需求增加,单卡双向通信带宽 已提升至 900GB,华为 384 节点单卡需 7 个接口。 HVDC 供电效率高,正向正负 400 伏或 800 伏方案转变,可节省铜材, Meta 和英伟达均提出高压直流方案,单机柜功率可达 800 千瓦。 国产电源及散热系统在国际市场上具有明显竞争优势。特别是在谷歌和亚马逊 ...
算力:从英伟达的视角看算力互连板块成长性 - Scale Up 网络的“Scaling Law”存在吗?
2025-08-21 15:05
Summary of Conference Call on Scale Up Network Growth from NVIDIA's Perspective Industry Overview - The discussion revolves around the **Scale Up network** in the context of **NVIDIA** and its implications for the broader **computing power** industry, particularly in AI and parallel computing applications [1][5][9]. Core Insights and Arguments - **Scaling Law**: The concept of a "Scaling Law" in networks is proposed, emphasizing the need for larger cross-cabinet connections rather than just existing ASIC and cabinet solutions [1][5]. - **NVIDIA's Strategy**: NVIDIA aims to address hardware memory wall issues and parallel computing demands by increasing **Nvlink bandwidth** and expanding the **Up scale** from H100 to GH200, although initial adoption was low due to high costs and insufficient inference demand [6][8]. - **Memory Wall**: The memory wall refers to the disparity between the rapid growth of model parameters and computing power compared to memory speed, necessitating more HBM interconnect support for model inference and GPU operations [1][10]. - **Performance Metrics**: The GB200 card shows significant performance differences compared to B200, with a threefold performance gap at 10 TPS, which increases to sevenfold at 20 TPS, highlighting the advantages of Scale Up networks under increased communication pressure [4][14][15]. - **Future Demand**: As Scale Up demand becomes more apparent, segments such as **fiber optics**, **AEC**, and **switches** are expected to benefit significantly, driving market growth [9][28]. Additional Important Points - **Parallel Computing**: The evolution of computing paradigms is shifting towards GPU-based parallel computing, which includes various forms such as data parallelism and tensor parallelism, each with different communication frequency and data size requirements [11][12]. - **Network Expansion Needs**: The need for a second-layer network connection between cabinets is emphasized, with recommendations for using fiber optics and AEC to facilitate this expansion [4][23][24]. - **Market Trends**: The overall network connection growth rate is anticipated to outpace chip demand growth, benefiting the optical module and switch industries significantly [28][30]. - **Misconceptions in Market Understanding**: There is a prevalent misconception that Scale Up networks are limited to cabinet-level solutions, whereas they actually require larger networks composed of multiple cabinets to meet user TPS demands effectively [29][30]. This summary encapsulates the key points discussed in the conference call, providing insights into the growth potential and strategic direction of the Scale Up network within the computing power industry.
芯片巨头,暗斗SerDes
半导体芯闻· 2025-06-10 09:52
Core Viewpoint - The article discusses the significant shift in the large chip market, particularly in the context of high-performance computing (HPC) and data centers, following Qualcomm's acquisition of Alphawave, a SerDes chip supplier, which alters the competitive landscape dominated by Intel, AMD, and Nvidia [1][15]. Summary by Sections SerDes Importance - SerDes technology is increasingly vital in data centers, enabling efficient communication over fewer cables, thus maximizing throughput [3]. - The evolution of SerDes has transitioned from long-distance communication to critical components in system-on-chip (SoC) designs [3]. Market Dynamics - The demand for high-bandwidth connections has surged due to data-intensive applications like machine learning, necessitating advanced SerDes solutions [4]. - The shift to FinFET technology has made managing analog mixed-signal architectures challenging, leading to a preference for digital signal processing (DSP)-based SerDes designs [5]. Chip Industry Competition - Major chip manufacturers, including Nvidia, Intel, AMD, and MediaTek, are heavily invested in SerDes technology, indicating its strategic importance in the data center market [8]. - Alphawave's rapid growth, achieving over $270 million in revenue within seven years, highlights the increasing demand for SerDes IP [8]. Nvidia's Innovations - Nvidia's proprietary NvLink technology, a custom SerDes solution, significantly enhances data transfer rates between GPUs, showcasing its competitive edge in the AI era [9][10]. Intel and AMD Developments - Intel has developed a 224-Gb/s PAM-4 SerDes, enhancing high-speed serial connections, while AMD's Infinity Fabric relies on high-performance SerDes for low-latency, high-bandwidth communication [11][12]. Qualcomm's Strategic Move - Qualcomm's acquisition of Alphawave is aimed at strengthening its position in the data center market, addressing its previous gaps in connectivity solutions [12][13]. - The acquisition also positions Qualcomm to leverage Alphawave's expertise in chiplet and custom ASIC technologies, further enhancing its competitive capabilities [13]. Future Outlook - With Qualcomm's aggressive entry into the CPU and AI markets, it is poised to become a significant player in the data center sector, intensifying competition among established giants like Nvidia, Intel, and AMD [15].
大芯片,巨变!
半导体行业观察· 2025-06-10 01:18
Core Viewpoint - The article discusses the significant shift in the large chip market, particularly in the context of high-performance computing (HPC) and data centers, following Qualcomm's acquisition of Alphawave, a SerDes chip supplier. This acquisition positions Qualcomm as a formidable player in a market previously dominated by Intel, AMD, and Nvidia [1][8]. Summary by Sections SerDes Importance - SerDes technology is increasingly vital in data centers, facilitating high-speed communication over fewer cables, thus maximizing throughput [3][4]. - The evolution of SerDes has transitioned from long-distance communication to a critical component in system-on-chip (SoC) designs, driven by the demand for high bandwidth in data-intensive applications [4][5]. Market Dynamics - The demand for high-bandwidth connections has surged due to the rise of data-intensive computing applications like machine learning [4]. - The integration of advanced technologies, such as FinFET, has made it challenging to manage analog mixed-signal architectures, leading to a shift towards digital signal processing (DSP)-based SerDes solutions [5][6]. Competitive Landscape - Major chip manufacturers, including Nvidia, Intel, AMD, and MediaTek, are heavily invested in SerDes technology, indicating its critical role in the data center market [8][9]. - Nvidia's proprietary NvLink technology exemplifies the competitive edge that advanced SerDes solutions can provide, enhancing data transfer rates significantly [9][10]. Qualcomm's Strategic Move - Qualcomm's acquisition of Alphawave is a strategic step to bolster its capabilities in the data center market, providing essential assets for high-performance computing [13][14]. - Alphawave's rapid growth and expertise in SerDes IP position it as a key player, with revenues increasing from zero to over $270 million in seven years [8][12]. Future Outlook - The article suggests that Qualcomm's entry into the data center market will intensify competition among traditional giants like Nvidia, Intel, and AMD, as well as other players like Broadcom and Marvell [16]. - The ongoing evolution in chip technology and the increasing importance of SerDes will continue to shape the competitive landscape in the semiconductor industry [16].