强化学习
Search documents
直击英伟达GTC
2025-04-15 14:30
Summary of Conference Call Company and Industry - The conference call primarily discusses **NVIDIA** and its advancements in the **AI and computing hardware industry**. Key Points and Arguments Product Launches and Innovations - NVIDIA introduced several new products during the conference, highlighting the shift in model architecture towards **reinforcement learning** which enhances the reasoning process during inference [1] - The **Blackwell Ultra NVLink 72** was announced, set to ship in the second half of the year, with bandwidth double that of the previous **GB200** series [2] - The **VR Ruby** is expected to ship in the second half of 2026, boasting performance that is **3.3 times** that of the **GB300 NVLink72** and supporting up to **288GB** of fast memory [3] - The next generation, **Ruby Ultra**, features **NVLink576**, which is **14 times** the performance of **GB300 NVLink72** and supports a bandwidth of **115.2T** [3][4] Hardware Architecture Changes - The architecture of the **NVLink576** has undergone significant changes, allowing for a denser configuration of **288 GPUs** in a single rack [4] - The importance of **PCB** (Printed Circuit Board) has increased, with a shift from copper cables to PCB interconnections, indicating a growth in PCB usage in the **Rubin** generation [5] Networking and Connectivity - NVIDIA announced two new **CPU switches**: the **Quantum X** (InfiniBand architecture) and **Spectrum X** (Ethernet version), with the Quantum X expected to deliver a total bandwidth of **115.2P** [6][7] - The **Quantum X** switch features **four ASICs** with **72 optical engines**, each capable of **200G** service, contributing to the overall bandwidth [7] Market Implications - The design of the **CPU switch** includes a **pluggable optical engine**, which reduces maintenance costs for cloud service providers, potentially increasing adoption rates [8][9] - NVIDIA's focus on applications includes the introduction of the **Dynamo AI inference software**, which can increase token generation by over **30 times** during model execution [10] - The company also showcased advancements in **autonomous driving** and robotics, including a foundational model for general-purpose robots and a comprehensive safety system for autonomous vehicles [10] Future Outlook - The demand for inference is expected to rise significantly due to the integration of reinforcement learning in models, indicating a positive outlook for both domestic and international computing power markets [11] Additional Important Content - The conference emphasized the strategic direction of NVIDIA in enhancing computing power and AI applications, which could lead to substantial growth opportunities in the tech industry [1][11]
DeepSeek-R1与Grok-3:AI规模扩展的两条技术路线启示
Counterpoint Research· 2025-04-09 13:01
自今年二月起,DeepSeek 便因其开源旗舰级推理模型DeepSeek-R1 而引发全球瞩目——该模型性能 堪比全球前沿推理模型。其独特价值不仅体现在卓越的性能表现,更在于仅使用约2000块NVIDIA H800 GPU 就完成了训练(H800 是H100 的缩减版出口合规替代方案),这一成就堪称效率优化的 典范。 几天后,Elon Musk 旗下xAI 发布了迄今最先进的Grok-3 模型,其性能表现略优于DeepSeek-R1、 OpenAI 的GPT-o1 以及谷歌的Gemini 2。与DeepSeek-R1 不同,Grok-3 属于闭源模型,其训练动用 了惊人的约20万块H100 GPU,依托xAI "巨像"超级计算机完成,标志着计算规模实现了巨大飞跃。 xAI "巨像" 数据中心 Grok-3 展现了无妥协的规模扩张——约200,000块NVIDIA H100 显卡追求前沿性能提升。而 DeepSeek-R1 仅用少量计算资源就实现了相近的性能,这表明创新的架构设计和数据策展能够 与蛮力计算相抗衡。 效率正成为一种趋势性策略,而非限制条件。DeepSeek 的成功重新定义了AI扩展方式的讨 论。我 ...
清北天才扎堆的机器人赛道 ,杀出一个大专生
3 6 Ke· 2025-04-08 12:45
Core Insights - The article highlights the journey of two entrepreneurs, Zhao Tongyang and Wang Xingxing, who started from humble beginnings in the robotics industry and have now become prominent figures in the humanoid robot sector [1][2][3][5][7]. Group 1: Background and Early Challenges - Both Zhao and Wang entered the robotics field in 2016, lacking prestigious educational backgrounds and facing significant challenges in securing funding [2][8][10]. - Zhao's initial ventures in bipedal robots faced financial difficulties, leading him to work for Xiaopeng Motors, while Wang struggled with funding and had to use personal savings to pay employees [2][3][16][17]. Group 2: Industry Evolution and Opportunities - The humanoid robot industry experienced a resurgence in 2023, driven by advancements in AI and large models, allowing both entrepreneurs to capitalize on new opportunities [3][23][29]. - Zhao's company, Zhongqing Robotics, raised nearly 400 million RMB in total funding over a year and a half, while Wang's Yushu Technology launched successful humanoid robots, gaining significant attention [3][24][29]. Group 3: Competitive Landscape and Future Prospects - The competition in the humanoid robot market is intensifying, with numerous startups and established tech giants like Tesla, Xiaomi, and Huawei entering the fray [27][29]. - Both Zhao and Wang are focusing on leveraging their past experiences and technological advancements to differentiate their products in a crowded market [25][29].
速递|DeepSeek联手清华新模型GRM开源,算力降低性能反升
Z Potentials· 2025-04-08 12:30
图片来源: DeepSeek DeepSeek 正与清华大学合作,致力于减少其 AI 模型所需的训练量,以降低运营成本, 开发自我进 化的 AI 模型。 DeepSeek 曾以一月份推出的低成本推理模型震动市场,现与高校研究人员联合发表论文,详述了一 种提升模型效率的强化学习新路径。研究人员写道,这种新方法旨在通过为更准确且易于理解的回答 提供奖励,帮助人工智能模型更好地遵循人类偏好。 强化学习在加速特定应用和领域内的 AI 任务方面已被证明有效,但将其扩展到更通用的场景一直充 满挑战——这正是 DeepSeek 团队试图通过其所谓的 " 自我原则批判调优 " 来解决的问题。 论文指出,该策略在多项基准测试中超越了现有方法和模型,结果显示能以更少的计算资源实现更优 性能。 DeepSeek 公司表示,将这些新模型命名为 DeepSeek-GRM (通用奖励建模的缩写),并将以开源形 式发布。 包括中国科技巨头阿里巴巴集团和美国旧金山的 OpenAI 在内的其他 AI 开发者,也正在开拓新领 域,致力于提升 AI 模型实时执行任务时的推理与自我优化能力。 Meta 于上周末发布了其最新 AI 模型系列 Llam ...
汽车行业周报:Optimus下一代执行器即将发布,自主车企3月销量表现亮眼-2025-04-06
Huaxin Securities· 2025-04-06 10:01
Investment Rating - The report maintains a "Recommended" investment rating for the automotive industry [1] Core Views - The upcoming release of Tesla's next-generation actuator, Optimus, is expected to enhance automation capabilities, with significant improvements in movement control and fluidity [4][5] - March sales data for domestic car manufacturers showed strong performance, with a year-on-year increase of 12% in retail sales, indicating a robust recovery in the Chinese automotive market [7][34] - The report emphasizes the potential for continued growth in the automotive sector, particularly for domestic brands like BYD, which saw a 25% increase in sales in March [5][7] Summary by Sections Market Performance and Valuation - The automotive sector's performance has lagged behind the broader market, with a decline of 3.5% in the CITIC Automotive Index compared to a 1.4% drop in the CSI 300 [15][24] - The current PE ratio for the automotive industry stands at 30.7, indicating a relatively high valuation compared to historical levels [24] Industry Data Tracking and Commentary - In March, the average daily retail sales of passenger cars reached 4.0 million units, reflecting a 14% year-on-year increase [33] - The report notes that the introduction of policies promoting vehicle replacement has positively impacted market dynamics, contributing to the sales growth observed in March [36] Recommended Stocks - The report highlights several key investment opportunities, including: - For complete vehicles: Companies like Seres and JAC Motors are recommended due to their collaboration with Huawei [8] - For automotive parts: Companies such as New Spring Co., Daimei Co., and Mould Technology are noted for their growth potential in the changing market landscape [40][41]
对话智元首席科学家罗剑岚:中国的具身智能圈比美国更加“务实”
Hu Xiu· 2025-04-04 06:03
Core Insights - The article discusses the return of Luo Jianlan to China and his role as the Chief Scientist at Zhiyuan, focusing on the development of embodied intelligence, a field that is increasingly attracting younger talent in China [1][3]. Group 1: Background and Career - Luo Jianlan has a strong academic background, having spent eight years in academic research after obtaining his PhD and postdoctoral degree from Berkeley, and previously worked at Google X and Google DeepMind [1]. - He is a proponent of Reinforcement Learning (RL) over Immitation Learning (IL), arguing that the uncertainty in the real world makes achieving high accuracy in IL nearly impossible [2]. Group 2: Research Center and Philosophy - At Zhiyuan, Luo Jianlan established the "Zhiyuan Embodied Research Center," which aims to bridge the gap between fundamental research and industrial application, emphasizing problem-driven research rather than merely publishing papers [3][14]. - The center is designed to be a middle platform that connects basic research with real-world deployment, avoiding strict boundaries between research and application [14][15]. Group 3: Industry Comparison - The article highlights a significant difference between the U.S. and China in the field of embodied intelligence, with the U.S. focusing heavily on basic research while China is more pragmatic and faster in commercializing technology [4][11]. - Luo Jianlan notes that the Chinese environment is more conducive to hardware development and data acquisition, which benefits the application of embodied intelligence [11][12]. Group 4: Challenges and Future Directions - The main challenge in the field remains manipulation, which involves accurately responding to the complexities and uncertainties of the external world [6][21]. - Luo Jianlan suggests that the future of embodied intelligence should focus on creating useful robots that can solve multiple tasks rather than striving for a universal robot [21].
蚂蚁清华联手放大招!彻底开源RL框架AReaL-boba,人人可复现QwQ
AI科技大本营· 2025-04-03 02:16
责编 |梦依丹 出品丨AI 科技大本营(ID:rgznai100) 3 月的最后一天,由蚂蚁与清华大学交叉信息研究院吴翼老师团队联合推出的开源强化学习框架 AReaL 发布了里程碑版本——AReaL boba,正如其 昵称"boba"(珍珠奶茶)所寓意的那样,AReaL 团队希望他们的工作能像美味且平易近人的奶茶一样,普惠整个 AI 开发社区,让每一位开发者都能 轻松驾驭强大的推理模型。 就像 AReaL 介绍里说的那番,他们将 完全致力于开源,发布所有重现所需性能模型的训练细节、数据和基础设施。 AReaL boba 不仅把模型、代 码、数据及实现细节通通开放出来,而且还提供非常详细的教程, 真正实现了"人人可手搓顶尖大模型"的愿景。 集成 SGLang 框架,效率大幅提升! AReaL boba 是首个全面拥抱 xAI 公司高性能推理框架 SGLang 的开源训练系统。 通过引入 SGLang 并进行一系列工程优化,AReaL v0.2 在 7B 模型 上的训练速度相较于 v0.1 提升了 1.5 倍,端到端训练性能提升高达 73%。如下图所示: 官网提供的表格进一步展示了 AReaL-boba 在不同资 ...
智元机器人首席科学家罗剑岚:如果机器人实现“操控”,是比大语言模型更高级的智能
Mei Ri Jing Ji Xin Wen· 2025-04-02 07:35
每经记者 朱成祥 每经编辑 魏官红 4月2日,智元机器人宣布与国际顶尖具身智能公司Physical Intelligence(Pi)达成合作伙伴关系,双方 将围绕动态环境下的长周期复杂任务,在具身智能领域展开深度技术合作。此外,近期正式加入智元的 罗剑岚,将全面领导智元具身智能研究中心,同时推进双方的深度合作。4月2日,罗剑岚接受了《每日 经济新闻》记者的采访。 罗剑岚认为:"强化学习是我们比较看重的一个技术,此外我们也看到DeepSeek R1所展现出的比较强的 推理能力。但光有模仿学习是不够的,后来我们还会有世界模型。根据我们云端的Model(模型),去 预测下一步环境会发生什么。不过这些都是工具,真正本质上需要解决的,是怎样在开放数据链构建 (具有)鲁棒的策略,然后感知、预测、行为生成这一整套机制的泛化能力,才是最核心、最关键 的。" 值得一提的是,汽车智能驾驶是收集到众多车辆的数据后,才慢慢发展起来的。当下人形机器人尚未大 规模应用于生活场景。如果缺乏足够的数据,人形机器人的"操控"该如何突破? 罗剑岚表示:"我也经常在想,这是一个循环。我们没有机器人部署到真实世界,它就不会产生数据; 机器人的能力没 ...
AI 写码一时爽,代码审查火葬场?GitHub Copilot 副总揭秘新瓶颈 | GTC 2025
AI科技大本营· 2025-03-31 06:55
我们距离 AI 在绝大多数软件开发任务中实现人类水平的能力和自主性大约还有 24 到 36 个月的时间。 责编 | 王启隆 出品丨AI 科技大本营(ID:rgznai100) 主持人: 大家好,我是 NVIDIA 开发者工具 AI 技术软件工程总监,马特·弗雷泽(Matt Frazier)。 众所周知,AI 辅助开发者工具,或者说代码生成、AI 代码生成——现在有很多叫法——正在从根本上改变我们开发软件的方式。NVIDIA 自然非常关 注这一趋势如何影响我们处理软件和加速计算的方法。 为此,在 GTC 2025(英伟达大会)上,我们邀请了来自多家公司和不同行业的 AI 代码生成通用应用专家,以及 CUDA 优化与相关研究领域的专家, 共同探讨这个话题。 我想快速问各位读者几个问题: 如果你对以上任何一个问题感同身受或感到好奇,那么接下来的讨论就值得你关注。下面,我想介绍一下参与本次讨论的嘉宾。 莎娜·达马尼(Sana Damani) ,她是 NVIDIA 架构研究组的研究科学家,致力于提升 GPU 上并行应用程序的性能,以及提高调试和优化工作的易用 性。 有多少人特别在 CUDA 调试中使用过 AI 驱动的代 ...
中关村论坛周末机器人“总动员”!机器人ETF基金(562360)连续3个交易日获得资金净流入,午后V型大反弹
Xin Lang Cai Jing· 2025-03-31 06:50
国金证券表示,机器人板块的投资价值在于其背后强大的产业趋势和技术革新。随着人工智能、机器学 习等技术的发展,机器人行业正经历着前所未有的变革,尤其是在人形机器人领域。例如,Figure公司 利用强化学习技术实现了人形机器人的高效训练,不仅缩短了开发周期,还提高了机器人的运动能力和 智能化水平。此外,vivo等消费电子巨头的加入,标志着机器人技术正逐渐渗透到日常生活中,预示着 未来市场的巨大潜力。 相关产品:机器人ETF基金(562360) 消息面上,3月27日-3月31日举办的2025中关村论坛年会现场,各式各样的机器人穿梭其间,上演着一 场现实版的 "机器人总动员"。它们有的化身咖啡师制作拉花,有的在舞台上演绎机械太极,有的用流 畅的双语引导外宾。 2025年3月31日,A股市场深V反弹,机器人板块午后临近收盘跳升。机器人指数成份股中,信捷电气、 华辰装备涨超4%,快克智能、科远智慧、燕麦科技、三丰智能涨超1%,其余成份股趋势上行。机器人 ETF基金(562360)实时成交额突破3700万元。 机器人ETF基金(562360)跟踪的中证机器人指数与万得人形机器人指数的成份股重合度为63%,除了 人形机器人以 ...