Workflow
Cosmos世界基础模型
icon
Search documents
英伟达要做Robotaxi,采用端到端+强化学习|36氪独家
3 6 Ke· 2025-10-14 09:51
英伟达业务版图再拓展。 黄仁勋曾多次公开强调,自动驾驶汽车不仅是"机器人技术的第一个主要商业应用",更是一个"数万亿 美元级别的产业"。 36氪从多处获悉,英伟达内部正在孵化Robotaxi项目,这项决定在近期的一项All hands meeting(全员 大会)上宣布,将交由就职多年的高级总监Ruchi Bhargava负责。 知情人士告诉36氪,新项目将采用全新的一段式技术路线。该技术路线仅使用一个"端到端"神经网络, 核心是通过仿真技术形成的世界模型对神经网络进行强化训练,与特斯拉FSD采用的路线相似。 英伟达今年1月发布了Cosmos世界基础模型。该平台通过整合文本、图像、视频及传感器数据,生成遵 循物理规律的高质量合成视频数据,并已经经过2000万小时数据的预训练。 Cosmos世界基础模型的意义之一,便是能够拓展现实场景难以产生的复杂数据,来提升自动驾驶系统 的能力上限。 这条路线已经得到行业的初步认可,理想、小鹏等企业均已着手打造自己的世界模型。 消息人士向36氪表示,英伟达发力Robotaxi,其逻辑并非简单的业务扩张,而是想推出一个"Robotaxi 的技术样本"。 此前,英伟达已与通用、奔 ...
欧美日韩等发达经济体无不关注的这一领域,为何成为汽车业竞逐的新焦点?
Core Insights - The application of artificial intelligence (AI) has become a focal point in the global automotive industry, with significant strategic initiatives being launched by various countries to leverage AI for automotive advancements [4][5][11] Group 1: Strategic Initiatives - The European Commission has introduced two strategies: "Applied AI" and "Scientific AI," aimed at accelerating AI applications in industries including automotive, with a focus on autonomous driving and innovative models [5] - In the U.S., tech giants like NVIDIA and Tesla are leading the charge in AI for automotive, with Tesla planning to invest over $10 billion in 2024 for the development of its Autopilot system [6] - South Korea and Japan are focusing on cross-industry collaboration to create smart ecosystems, with initiatives like AI-connected electric vehicles and alliances among automakers to develop autonomous driving technologies [7] Group 2: Market Trends and Data - According to EU statistics, only 13.5% of companies with 10 or more employees in the EU are currently using AI in their operations, indicating significant room for growth [5] - The global autonomous driving market is projected to exceed $200 billion by 2030, highlighting the potential for smart vehicles to become the mainstream mode of transportation [11] Group 3: Technological Challenges - Despite rapid advancements, the automotive industry faces technical challenges, particularly in the reliability of autonomous driving systems under complex conditions and extreme weather [9] - Data privacy and cybersecurity issues are becoming increasingly prominent, with concerns over user data collection and potential hacking threats to vehicle systems [9][10] Group 4: Regulatory Landscape - There are discrepancies in regulations regarding autonomous driving across different regions, with the U.S. having varying state laws and the EU imposing strict data flow regulations, complicating global deployment of smart vehicles [10] - Calls for unified international regulations and standards are growing, as current disparities hinder the global development of the smart automotive industry [10]
英伟达一口气开源多项机器人技术,与迪士尼合作研发物理引擎也开源了
量子位· 2025-10-02 03:26
Core Viewpoint - NVIDIA has made significant advancements in robotics by releasing multiple open-source technologies, including the Newton physics engine, which enhances robots' physical intuition and reasoning capabilities, addressing key challenges in robot development [1][4][10]. Group 1: Newton Physics Engine - The Newton physics engine aims to solve the challenge of transferring skills learned in simulation to real-world applications, particularly for humanoid robots with complex joint structures [4]. - It is an open-source project managed by the Linux Foundation, built on NVIDIA's Warp and OpenUSD frameworks, utilizing GPU acceleration to simulate intricate robot movements [4]. - Leading institutions such as ETH Zurich and Peking University have already begun using the Newton engine, indicating its adoption by top-tier robotics companies and universities [4][3]. Group 2: Isaac GR00T N1.6 Model - The Isaac GR00T N1.6 model integrates the Cosmos Reason visual language model, enabling robots to understand and execute vague commands, a longstanding challenge in the industry [5][6]. - This model allows robots to convert ambiguous instructions into actionable plans while performing simultaneous movements and object manipulations [6]. - The Cosmos Reason model has surpassed 1 million downloads, and the accompanying open-source physical AI dataset has exceeded 4.8 million downloads, showcasing its popularity and utility [6]. Group 3: Training Innovations - The Isaac Lab 2.3 developer preview introduces a new workflow for teaching robots to grasp objects, utilizing an "automated curriculum" that gradually increases task difficulty [8]. - This approach has been successfully implemented by Boston Dynamics' Atlas robot, enhancing its manipulation capabilities [8]. - NVIDIA has collaborated with partners to develop the Isaac Lab Arena, a framework for large-scale experiments and standardized testing, streamlining the evaluation process for developers [8]. Group 4: Hardware Infrastructure - NVIDIA has invested in hardware advancements, including the GB200 NVL72 system, which integrates 36 Grace CPUs and 72 Blackwell GPUs, already adopted by major cloud service providers [9]. - The Jetson Thor, equipped with Blackwell GPUs, supports multiple AI workflows for real-time intelligent interactions, with several partners already utilizing this technology [9]. - Nearly half of the papers presented at CoRL referenced NVIDIA's technologies, highlighting the company's influence in the robotics research community [9]. Group 5: Comprehensive Strategy - NVIDIA's "full-stack" approach, encompassing open-source physics engines, foundational models, training workflows, and hardware infrastructure, is redefining the landscape of robotics development [10]. - The advancements suggest that the integration of robotics into everyday life may occur sooner than anticipated [11].
英伟达做Robotaxi,马斯克你怎么看?
Sou Hu Cai Jing· 2025-09-18 09:46
Core Insights - Nvidia is incubating a new Robotaxi project led by senior director Ruchi Bhargava, utilizing an end-to-end technology approach that leverages simulation to enhance neural network training, similar to Tesla's Full Self-Driving (FSD) strategy but with a stronger technical foundation [4][5] - The project is supported by Nvidia's Cosmos world model, which integrates various data types to generate high-quality synthetic video data, having completed 20 million hours of pre-training [4] - Nvidia plans to invest $3 billion in the Robotaxi project, contrasting with Waymo's cumulative investment of approximately $12 billion to achieve its current operational scale [5] Company Strategy - The aim of Nvidia's Robotaxi initiative is not merely business expansion but to validate its full-chain engineering capabilities from GPU chips to physical AI models, thereby defining the infrastructure and ecological standards for the next generation of "physical AI" [5] - The US Robotaxi market is expected to accelerate by 2025, with Waymo operating in seven cities and Tesla launching services in Austin and the Bay Area, achieving significant download numbers [5][6] Competitive Landscape - Despite facing challenges in autonomous driving software, Nvidia possesses significant advantages, including its self-developed DRIVE Thor chip with a computing power of 2000 TOPS, enhancing end-to-end model inference efficiency [6] - Industry experts note that the Robotaxi market is still in its early stages, with Waymo operating around 700 vehicles and Tesla deploying only a few dozen in Austin, indicating that Nvidia's entry is timely and offers opportunities to compete for technological leadership [6] Financial Outlook - Nvidia's net profit for Q2 2025 is projected to reach $26.4 billion, providing substantial funding for long-term research and development [6] - Jensen Huang, Nvidia's CEO, emphasizes that autonomous vehicles represent a major commercial application of robotics and a multi-trillion-dollar industry [6]
“反击”马斯克,奥特曼说OpenAI有“好得多”的自动驾驶技术
3 6 Ke· 2025-07-07 00:32
Group 1: Conflict Between OpenAI and Tesla - The conflict between OpenAI CEO Sam Altman and Tesla CEO Elon Musk has become a hot topic in Silicon Valley, with Musk accusing Altman of deviating from OpenAI's original mission after its commercialization [1] - Musk has filed a lawsuit against Altman for allegedly breaching the founding agreement, while also establishing xAI to compete directly with OpenAI [1] - Altman has countered Musk's claims by revealing emails that suggest Musk attempted to take control of OpenAI and has been obstructing its progress since being denied [1] Group 2: OpenAI's Autonomous Driving Technology - Altman has hinted at new technology that could enable self-driving capabilities for standard cars, claiming it to be significantly better than current approaches, including Tesla's Full Self-Driving (FSD) [3][4] - However, Altman did not provide detailed information about this technology or a timeline for its development, indicating that it is still in the early stages [5] - The technology is believed to involve OpenAI's Sora video software and its robotics team, although OpenAI has not previously explored autonomous driving directly [6][7] Group 3: Sora and Its Implications for Autonomous Driving - Sora, a video generation model released by OpenAI, can create high-fidelity videos based on text input and is seen as a potential tool for simulating and training autonomous driving systems [10] - While Sora's generated videos may not fully adhere to physical principles, they could still provide valuable data for training models, particularly in extreme scenarios [10][11] - The concept of "world models" in autonomous driving aligns with Sora's capabilities, as it aims to help AI systems understand the physical world and improve driving performance [11][21] Group 4: OpenAI's Investments and Collaborations - OpenAI has made investments in autonomous driving companies, such as a $5 million investment in Ghost Autonomy, which later failed, and a partnership with Applied Intuition to integrate AI technologies into modern vehicles [12][15] - The collaboration with Applied Intuition focuses on enhancing human-machine interaction rather than direct autonomous driving applications [15] - OpenAI's shift towards multi-modal and world models indicates a strategic expansion into spatial intelligence, which could eventually benefit autonomous driving efforts [16][24] Group 5: Industry Perspectives on AI and Autonomous Driving - Experts in the AI field, including prominent figures like Fei-Fei Li and Yann LeCun, emphasize the need for AI to possess a deeper understanding of the physical world to effectively drive vehicles [19][20] - NVIDIA's introduction of the Cosmos world model highlights the industry's focus on creating high-quality training data for autonomous systems, which could complement OpenAI's efforts [22][24] - The autonomous driving market is recognized as a multi-trillion-dollar opportunity, making it a critical area for competition between companies like OpenAI and Tesla [24]