为什么机器人行业有这么多开源模型 这是做慈善还是钱太多烧得慌 为什么机器人开源模型能够打败谷歌 这背后是谁在下怎么样的一盘大棋呢 2月前后 小米、蚂蚁、阿里达摩院、宇树 纷纷发布机器人开源模型 再往前 英伟达在CES上 发布了GR00T N1.6% 把自家号称 “世界首个开放人形机器人基础模型” 又再度升级 我们不仅开源了模型 还开源了用于训练这些模型的数据 这些个消费电子公司 互联网巨头 还有芯片帝国 最近都一股脑地 把机器人的“大脑”拿出来 免费给全世界用 机器人开源模型的生态当中 有什么样的心机 和万亿美元押注的博弈呢 Hello 大家好 欢迎来到《硅谷101》 我是陈茜 这个视频我们就来继续聊聊机器人系列 之前我们机器人“闭源模型”那期 分析了如今具身智能通用的VLA模型 拆解了特斯拉、Figure 这些闭源巨头的不同路线 以及它们如何用硬件和数据优势 构筑护城河 而这个视频 我们与全球顶尖 具身智能实验室的研究人员深聊之后 来扒一扒开源算法路线中的核心玩家 和关键的技术领军人物们 同时我们来试图回答这三个问题 第一 这些开源模型 分别走了什么样的技术路线 为什么能够挑战巨头 第二 开源的动机是什么 ...

Core Insights - The article discusses the launch of RoboChallenge, a large-scale, multi-task benchmark testing platform for embodied intelligence, initiated by Dexmal and Hugging Face, aimed at addressing the lack of real machine testing in the field [5][41]. Group 1: Challenges in the Embodied Intelligence Field - The embodied intelligence sector has seen rapid advancements, but the absence of real machine testing and limitations of existing evaluation systems have become significant bottlenecks [3][4]. - Current mainstream benchmarks primarily rely on simulation environments, leading to issues where algorithms that perform well in simulations fail in real-world applications [4][10]. Group 2: Introduction of RoboChallenge - RoboChallenge is the first large-scale benchmark testing platform that allows real robots to perform tasks in a physical environment, providing a more reliable and comparable evaluation standard for visual language action models (VLAs) [5][10]. - The platform aims to overcome challenges related to performance validation in real environments, standardized testing conditions, and accessibility [5][10]. Group 3: Features of RoboChallenge - RoboChallenge features a "remote robot" paradigm, allowing users to interact with real machines without needing hardware, thus lowering the entry barrier for researchers and developers [15][19]. - The platform supports a wide range of tasks, with an initial benchmark set (Table30) comprising 30 diverse tasks designed to evaluate core capabilities of VLA models [12][26]. Group 4: Evaluation Mechanism - The evaluation mechanism combines end-to-end task success rates with process scoring, ensuring a rigorous and transparent assessment of models [16][20]. - RoboChallenge employs a "visual input matching" method to ensure consistency in testing conditions, reducing variability caused by human testers [23][25]. Group 5: Open and Collaborative Ecosystem - RoboChallenge promotes an open ecosystem by providing free access to evaluation services, publicly sharing task demonstration data, and ensuring transparency in results [34][41]. - The platform encourages collaboration among researchers, developers, and industry professionals, fostering innovation in the field of embodied intelligence [38][41]. Group 6: Future Directions - RoboChallenge plans to expand its capabilities by introducing more robot types and challenging tasks, aiming to enhance the evaluation of embodied intelligence in real-world scenarios [42].

Core Viewpoint - The article discusses the transformative impact of large Vision-Language Models (VLMs) on robotic manipulation, enabling robots to understand and execute complex tasks through natural language instructions and visual cues [3][4][5]. Group 1: VLA Model Development - The emergence of Vision-Language-Action (VLA) models, driven by large VLMs, allows robots to interpret visual details and human instructions, converting this understanding into executable actions [4][5]. - The article highlights the evolution of VLA models, categorizing them into monolithic and hierarchical architectures, and identifies key challenges and future directions in the field [9][10][11]. Group 2: Research Contributions - The research from Harbin Institute of Technology (Shenzhen) provides a comprehensive survey of VLA models, detailing their definitions, core architectures, and integration with reinforcement learning and human video learning [5][9][10]. - The survey aims to unify terminology and modeling assumptions in the VLA field, addressing fragmentation across disciplines such as robotics, computer vision, and natural language processing [17][18]. Group 3: Technical Advancements - VLA models leverage the capabilities of large VLMs, including open-world generalization, hierarchical task planning, knowledge-enhanced reasoning, and rich multimodal integration [13][64]. - The article outlines the limitations of traditional robotic methods and how VLA models overcome these by enabling robots to handle unstructured environments and vague instructions effectively [16][24]. Group 4: Future Directions - The article emphasizes the need for advancements in 4D perception and memory mechanisms to enhance the capabilities of VLA models in long-term task execution [5][16]. - It also discusses the importance of developing unified frameworks for VLA models to improve their adaptability across various tasks and environments [17][66].

Core Viewpoint - Physical Intelligence (PI) is advancing the development of general-purpose robots by enhancing their capabilities through the introduction of the Visual-Language-Action (VLA) model, which integrates visual perception and action generation for robots in open environments [2][6][12]. Group 1: VLA and Its Development - VLA is an application of Visual-Language Models (VLM) in robotics, enabling robots to understand and generate action commands based on visual and textual inputs [6][12]. - The PI team has built a comprehensive data engine from scratch, emphasizing the importance of data diversity in improving robot generalization [3][31]. - The introduction of the "Knowledge Insulation" mechanism aims to address the limitations of traditional model training by restructuring the training process [3][47]. Group 2: Challenges in Open World Deployment - The three main challenges in deploying robots in open environments are data gaps, performance instability, and the complexity of hardware platform migration [3][54]. - Data scarcity in robotics is a significant issue, as the required interaction data is not as readily available as textual data on the internet [54]. - Performance stability remains a challenge, with current models being more demonstration-ready than deployment-ready, necessitating further algorithmic breakthroughs [54][56]. Group 3: Future Directions and Innovations - PI aims to create a universal and customizable robotic intelligence ecosystem, allowing various robots to perform diverse tasks through natural language commands [61][62]. - The company is exploring the concept of "Robot Model as a Service" (RMaaS), which would provide tailored robotic solutions through cloud and local deployment [62]. - The focus for the next 1-2 years will be on overcoming performance bottlenecks and developing standardized evaluation systems to ensure reliable model performance across different environments [60][61].

Core Viewpoint - The article emphasizes the rapid evolution and significance of Vision-Language-Action (VLA) models in the field of embodied intelligence, highlighting their potential to revolutionize human-robot interaction and the robotics industry as a whole [4][6][17]. Group 1: VLA Model Development - VLA models are becoming the core driving force in embodied intelligence, gaining traction among researchers and companies globally [7][8]. - Google recently released the first offline VLA model, enabling robots to perform tasks without internet connectivity [9]. - The emergence of the Fast-in-Slow (FiS-VLA) model in China represents a significant advancement, integrating fast and slow systems to enhance robotic control efficiency and reasoning capabilities [10][12]. Group 2: Academic and Industry Trends - There has been an explosive growth in academic papers related to VLA, with 1,390 papers published this year alone, accounting for nearly half of all related research [14]. - The VLA technology is facilitating the transition of robots from laboratory settings to real-world applications, indicating its vast potential [16][17]. Group 3: Key Innovations and Breakthroughs - The RT-2 model from Google marked a pivotal moment in VLA development, introducing a unified model architecture that integrates visual, language, and action modalities [38][40]. - The RoboMamba model, developed in China, significantly improved efficiency and reasoning capabilities in VLA models, achieving a threefold increase in inference speed compared to mainstream models [52][48]. - OpenVLA, another significant model, demonstrated superior performance in various tasks while being more efficient than previous models, achieving a 16.5% higher success rate than RT-2 [57][58]. Group 4: Future Directions and Implications - The introduction of the π series models aims to enhance VLA's generalization capabilities, allowing robots to perform complex tasks with minimal training [62][70]. - The FiS-VLA model represents a breakthrough in real-time control, achieving an 11% improvement in success rates in real environments compared to existing methods [114]. - The advancements in VLA technology are paving the way for robots to operate effectively in diverse environments, marking a significant step towards achieving Artificial General Intelligence (AGI) [127][123].