机器之心PRO · 会员通讯 Week 28 --- 本周为您解读 ③ 个值得细品的 AI & Robotics 业内要事 --- 1. 下一代 AI 系统怎么改？让 AI 自己改？! 人类数据为何不足以支撑「经验时代」？DGM 验证了怎样的路径？「自进化」范式有哪些特征？让 AI 自我改进的框架和 RL 有 何异同？「自进化」有哪些研究视角？未来的「自进化」方案来自模块的排列组合？ ？... 2. 智元启动「买买买」，路径未明，资本抢跑，主流技术范式下谁在领跑具身智能赛道？ 相比端到端，双系统架构是否在高复杂场景下更稳定？大多数具身智能公司都倾向「自研本体+定制模型」的路径？从轮式、四 足到人形，不同本体背后有哪些模型设计差异？2025 年上半年，具身行业谁最受资本青睐？智元收购上纬新材，具身智能技术 未成却资本先行？ ... 3. Brett Adcock：装可爱的机器人没有未来？! Figure AI 已经在筹备量产了？Brett Adock 的飞机公司为做机器人带来了哪些经验？哪些要素促成了机器人能力的指数级突 破？Figure AI 也在「沿途下蛋」？为什么装可爱的机器人无法被社会接受？为什么没有机 ...

Core Insights - The article discusses the transition from the "human data era" to the "experience era" in artificial intelligence, emphasizing the need for AI to learn from first-hand experiences rather than relying solely on human-generated data [2][5][10] - Richard S. Sutton highlights the limitations of current AI models, which are based on second-hand experiences, and advocates for a new approach where AI interacts with its environment to generate original data [6][7][11] Group 1: Transition to Experience Era - The current large language models are reaching the limits of human data, necessitating a shift to real-time interaction with environments to generate scalable original data [7][10] - Sutton draws parallels between AI learning and human learning, suggesting that AI should learn through sensory experiences similar to how infants and athletes learn [6][8] - The experience era will require AI to develop world models and memory systems that can be reused over time, enhancing sample efficiency through high parallel interactions [3][6] Group 2: Decentralized Cooperation vs. Centralized Control - Sutton argues that decentralized cooperation is superior to centralized control, warning against the dangers of imposing single goals on AI, which can stifle innovation [3][12] - The article emphasizes the importance of diverse goals among AI agents, suggesting that a multi-objective ecosystem fosters innovation and resilience [3][12][13] - Sutton posits that human and AI prosperity relies on decentralized cooperation, which allows for individual goals to coexist and promotes beneficial interactions [12][14][16] Group 3: Future of AI Development - The development of fully intelligent agents will require advancements in deep learning algorithms that enable continuous learning from experiences [11][12] - Sutton expresses optimism about the future of AI, viewing the creation of superintelligent agents as a positive development for society, despite the long-term nature of this endeavor [10][11] - The article concludes with a call for humans to leverage their experiences and observations to foster trust and cooperation in the development of AI [17]

晓静 腾讯科技《AI未来指北》特约作者 2025 年 6 月 6 日，第七届北京智源大会在北京正式开幕，强化学习奠基人、2025年图灵奖得主、加拿 大计算机科学家Richard S. Sutton以"欢迎来到经验时代"为题发表主旨演讲，称我们正处在人工智能史上 从"人类数据时代"迈向"经验时代"的关键拐点。 Sutton指出，当今所有大型语言模型依赖互联网文本和人工标注等"二手经验"训练，但高质量人类数据 已被快速消耗殆尽，新增语料的边际价值正急剧下降；近期多家研究也观察到模型规模继续膨胀却收效 递减的"规模壁垒"现象，以及大量科技公司开始转向合成数据。 以下为演讲全文： 当前大型模型已逼近"人类数据"边界，唯有让智能体通过与环境实时交互来生成可随能力指数级扩 张的原生数据，AI 才能迈入"经验时代" 。 真正的智能应像婴儿或运动员那样在感知-行动循环中凭第一人称经验自我学习 。 强化学习范例（如 AlphaGo、AlphaZero）已证明从模拟经验到现实经验的演进路径，未来智能体 将依靠自生奖励和世界模型实现持续自我提升 。 基于恐惧的"中心化控制"会扼杀创新，多主体维持差异化目标并通过去中心化合作实现双赢 ...

Core Viewpoint - The article emphasizes that true intelligence in AI should stem from experience rather than pre-set human data and knowledge, marking a shift towards an "Era of Experience" in AI development [5][16]. Summary by Sections Introduction to the Era of Experience - The current era in AI is characterized by a transition from reliance on human-generated data to a focus on experiential learning, where AI systems learn through interaction with the world [9][16]. Key Insights from Richard Sutton's Speech - Richard Sutton argues that genuine AI must have a dynamic data source that evolves with its capabilities, as static datasets will become inadequate [6][9]. - He highlights that the essence of intelligence lies in the ability to predict and control sensory inputs, which is fundamental to AI and intelligence [13]. The Learning Process - The learning process in both humans and animals is based on interaction with the environment, where actions determine the information received, leading to a deeper understanding [10][11]. - Sutton illustrates that AI should emulate this learning process by engaging with the world to generate new data and enhance its capabilities [10][12]. Transition from Human Data to Experience - The article outlines a timeline of AI evolution, indicating that the current "Human Data Era" is nearing its end, paving the way for the "Experience Era" where AI learns through real-world interactions [14][16]. - Sutton emphasizes that the future of AI lies in its ability to continuously learn from experiences, which is essential for unlocking the full potential of the "Experience Era" [17]. Decentralized Cooperation - The concept of "decentralized cooperation" is introduced as a framework for understanding social organization, where multiple agents pursue their own goals while collaborating for mutual benefit [24][25]. - Sutton argues that human prosperity and the future of AI should be built on this foundation of decentralized cooperation rather than centralized control [27][28]. Conclusion - The article concludes by encouraging a shift in perspective towards viewing interactions between humans and AI through the lens of decentralized cooperation versus centralized control, which could provide valuable insights into future developments in AI [28].