Workflow
机器之心
icon
Search documents
惊了,我的电脑在自动打工!花不到1块钱雇个「AI超人」,Office三件套被卷死
机器之心· 2025-05-26 01:28
Core Viewpoint - The article highlights the emergence of the "Skywork Super Agents" by Kunlun Wanwei as a groundbreaking product in the AI agent space, showcasing its advanced capabilities and potential to revolutionize content creation and productivity tools in the workplace [5][6][64]. Group 1: Product Features - Skywork integrates five expert-level AI agents, enabling users to generate professional documents, spreadsheets, presentations, podcasts, and web pages seamlessly [6]. - It offers a universal AI agent capable of producing multimodal content, including music, MV, promotional videos, picture books, and audiobooks [7]. - Skywork excels in benchmark tests, outperforming competitors like Manus and OpenAI in various assessments, including GAIA and SimpleQA [9][11]. - The product is the first globally to provide an open-source deep research agent framework, allowing developers to participate in defining AI agents [14]. - It features three major MCP interfaces for document generation, data analysis, and presentation creation, establishing itself as a core "AI operating system" for developers [15]. Group 2: User Experience and Functionality - Skywork's user interface allows for easy interaction, enabling users to generate scripts, analyze data, create presentations, and develop web pages with simple prompts [19][26][31][33]. - The platform supports visual data analysis, generating structured and informative sheets with visual representations like pie charts and bar graphs [30]. - It provides a robust PPT generation feature, producing visually appealing and informative presentations based on user prompts [32]. - Skywork can create playable web games and podcasts, demonstrating its versatility in content generation [35][37]. Group 3: Competitive Advantage - Skywork distinguishes itself through its task collaboration, multimodal generation, and high credibility of results, addressing pain points faced by competitors [44]. - The integration of document, spreadsheet, and presentation tools enhances productivity for users, allowing for detailed and organized content generation [45]. - It offers flexible export formats, including PPTX, PDF, HTML, and Google Slides, catering to various user needs [50]. Group 4: Technological Innovations - Skywork employs self-developed technologies, including a deep research model and an agent workflow framework, to enhance its performance and capabilities [61][63]. - The platform's ability to break down complex tasks into manageable components allows for efficient processing and execution [62]. - It incorporates a personal knowledge base feature, enabling users to upload various document formats and create a sustainable content cycle [58]. Group 5: Market Implications - The launch of Skywork signifies a strategic breakthrough for Kunlun Wanwei, positioning it competitively against international players in the AI agent market [66]. - The article suggests that the rise of AI agents like Skywork may lead to a significant transformation in workplace productivity, potentially automating many tasks currently performed by humans [67].
微软副总裁X上「开课」,连更关于RL的一切,LLM从业者必读
机器之心· 2025-05-26 01:28
Core Viewpoint - The article discusses the educational series on artificial intelligence initiated by Nando de Freitas, focusing on reinforcement learning (RL) and its applications in large language models (LLMs) [1][2]. Summary by Sections Introduction to AI Education - Nando de Freitas aims to educate readers on AI through a series of posts on X, starting with reinforcement learning and gradually covering diffusion and flow matching technologies [1][2]. Learning Types - The article highlights that there is no ultimate conclusion on unsupervised learning, supervised learning, and reinforcement learning [8][19]. - Supervised learning is described as basic imitation, requiring high-quality expert data for effective learning [9]. - Reinforcement learning focuses on selective imitation, allowing agents to learn from suboptimal experiences and improve their performance [10][11]. Distributed Reinforcement Learning Systems - Modern distributed RL systems consist of two main components: Actors and Learners, where Actors interact with the environment and collect data, while Learners update the policy network based on this data [23][24]. - The importance of measuring operational durations and communication bandwidth in such systems is emphasized [24][27]. Offline Reinforcement Learning - Offline RL has unique value in scenarios like post-training LLMs, where it can leverage historical data for learning [28][29]. Single-step and Multi-step RL - The article differentiates between single-step and multi-step RL problems, with single-step focusing on immediate actions and multi-step involving planning over a series of interactions [35][39]. - The complexity of multi-step RL is noted, particularly in credit assignment issues where multiple decisions affect outcomes [40][41]. Policy Gradient and Techniques - Policy gradient methods are discussed, including the use of baseline subtraction to reduce variance in reward signals [49][56]. - The article also covers the significance of KL divergence in maintaining proximity to supervised fine-tuning strategies during post-training [69]. Importance Sampling and PPO - Importance sampling is introduced as a method to correct off-policy sample bias, with Proximal Policy Optimization (PPO) being a key technique to manage policy updates [73][78]. - The integration of various techniques in training models like DeepSeek-R1 is highlighted, showcasing the complexity of modern RL systems [81]. Future Directions - Freitas plans to expand the discussion from single-step to multi-step RL, indicating ongoing developments in the field [82].
开源·开放·开创,2025张江具身智能开发者大会暨国际人形机器人技能大赛即将启幕
机器之心· 2025-05-25 10:02
Core Insights - The 2025 Zhangjiang Embodied Intelligence Developer Conference and International Humanoid Robot Skills Competition will take place on May 29, 2025, gathering global innovation forces to discuss cutting-edge technologies and showcase skills in humanoid robotics [1][2][4] Group 1: Event Overview - The event will feature a summit, competition, and exhibition, with over 200 humanoid robot industry chain companies and more than 1,000 experts and developers participating [1] - A total of 3,000 square meters will be dedicated to showcasing industry innovations during the exhibition [1] - The conference aims to accelerate the application of humanoid robot technology from laboratories to real-world scenarios through various initiatives, including the launch of the Zhangjiang Embodied Intelligence Fund [1][4] Group 2: Industry Development in Zhangjiang - Zhangjiang Science City is positioned as a hub for humanoid robot innovation, supported by comprehensive policies, a mature industrial ecosystem, and strong research capabilities [2] - The National-Local Joint Humanoid Robot Innovation Center has released the world's first full-size humanoid robot public version "Qinglong" and established the OpenLoong humanoid robot open-source community [2][4] Group 3: Competition Details - The 2025 International Humanoid Robot Skills Competition will consist of five tracks, covering various aspects of humanoid robots and embodied intelligence [6][10] - The competition tracks include application scenario challenges, core component technology innovation, humanoid robot soccer challenges, and a talent show for embodied robots [5][6][12] Group 4: Forum and Discussions - The conference will host one main forum and nine developer forums, featuring prominent experts discussing trends in humanoid robotics and embodied intelligence [14][17] - Topics will include "Human-like Robot Industry Application Thoughts" and "Breaking Barriers in Embodied Intelligence Innovation Development" [17] Group 5: Exhibition Highlights - The exhibition will cover four main themes: humanoid robots, embodied intelligence, humanoid robot industry chain, and developer ecosystem, showcasing the latest achievements in the humanoid robot industry [17][21] - Attendees will experience innovative humanoid robots demonstrating various capabilities, including interaction and performance [22]
只用图像也能思考,强化学习造就推理模型新范式!复杂场景规划能力Max
机器之心· 2025-05-25 03:51
例如,模型虽然能够识别图像中的物体并描述它们之间一些相对简单的空间关系,但在追求极致的定位精度,或需要深入理解和预测物体间高度复杂、动态或隐 含的交互逻辑(而非仅仅识别表面现象)时,其表现仍可能因视觉信息在文本化过程中的细节损失而受到限制。 机器之心报道 编辑:Panda、+0 近年来,LLM 及其多模态扩展(MLLM)在多种任务上的推理能力不断提升。然而, 现有 MLLM 主要依赖文本作为表达和构建推理过程的媒介,即便是在处理 视觉信息时也是如此 。 常见的 MLLM 结构。 这种模式要求模型首先将视觉信息「翻译」或「映射」为文本描述或内部的文本化 token,然后再利用大型语言模型的文本推理能力进行处理。 这个转换过程不可避免地可能导致视觉信息中固有的丰富细节、空间关系和动态特征的丢失或削弱,形成了所谓的「模态鸿沟 (modality gap) 」。这种鸿沟不仅限 制了模型对视觉世界的精细感知,也影响了其在复杂视觉场景中进行有效规划的能力。 来自剑桥、伦敦大学学院、谷歌的研究团队认为: 语言不一定始终是进行推理最自然或最有效的模态,尤其是在涉及空间与几何信息的任务场景中 。 基于此动因,研究团队提出了一种 ...
312条轨迹激发241%性能!上交大与SII开源电脑智能体,超越 Claude 3.7
机器之心· 2025-05-25 03:51
Core Insights - The article discusses the advancements in computer agents, particularly highlighting the performance improvements achieved by using a minimal amount of human-annotated data, specifically 312 human operation trajectories, to train the PC Agent-E model, which surpassed previous models in performance [1][3][10]. Group 1: Model Development - The research indicates that current large models possess the foundational capabilities to complete tasks using computers, with performance bottlenecks primarily related to long-horizon planning, which can be significantly enhanced with a small number of high-quality trajectories [3][13]. - The team utilized a tool called PC Tracker to collect 312 human operation trajectories, which included task descriptions, screenshots, and keyboard/mouse operations, ensuring data accuracy [4][10]. - The PC Agent-E model was trained on the open-source model Qwen2.5-VL-72B, achieving a performance increase of 241% compared to its initial state, demonstrating high sample efficiency [10][11]. Group 2: Methodology Innovations - A key innovation in the research is the "Thought Completion" process, which adds reasoning behind each action taken by humans, thereby enhancing the quality of the training data [7][8]. - The "Trajectory Boost" method was introduced to synthesize additional action decisions for each step in the trajectory, capturing the inherent diversity of possible actions for computer tasks, which significantly enriched the training data [8][11]. - The results showed that as the number of synthesized actions increased, model performance improved significantly, validating the effectiveness of the trajectory enhancement method [11][12]. Group 3: Performance Evaluation - PC Agent-E was evaluated on the WindowsAgentArena-V2, outperforming the Claude 3.7 Sonnet's extended thinking mode, marking it as the new state-of-the-art (SOTA) for open-source computer agents on Windows systems [10][11]. - The research concluded that a small number of high-quality trajectories can effectively stimulate a powerful long-horizon planning capability in agents, reducing the need for vast amounts of human-annotated data [13].
50年僵局打破!MIT最新证明:对于算法少量内存胜过大量时间
机器之心· 2025-05-25 03:51
Core Viewpoint - The article discusses a groundbreaking research by Ryan Williams that challenges the long-held belief in computer science regarding the relationship between time and space in algorithm execution, suggesting that a small amount of computational memory is theoretically more valuable than a large amount of computational time [1][3]. Group 1: Historical Context - In 1965, Juris Hartmanis and Richard Stearns established rigorous mathematical definitions for "time" and "space," providing a common language for researchers to categorize problems into complexity classes [5][6]. - The complexity class P includes problems solvable in reasonable time, while PSPACE includes problems solvable with a reasonable amount of space, with researchers believing PSPACE is significantly larger than P [7][8]. Group 2: Breakthrough in Complexity Theory - For 50 years, researchers struggled to prove that PSPACE is strictly larger than P, facing a fundamental barrier due to the limitations of previous simulation methods [8][9]. - In 2023, James Cook and Ian Mertz overturned a long-standing assumption about memory usage in algorithms, leading to a new algorithm that could solve the tree evaluation problem with significantly less space than previously thought [10][12]. Group 3: Williams' Revolutionary Approach - Ryan Williams recognized that the new algorithm by Cook and Mertz could serve as a universal space compression tool, allowing for the design of a new simulation mechanism that links time and space complexity more effectively [14][15]. - Williams' method involves breaking down the computation process into blocks and transforming it into a tree evaluation problem, optimizing the space complexity to O(√t log t), where t is the total computation time [16].
Now, Scaling What?
机器之心· 2025-05-24 14:12
Group 1 - The core viewpoint of the article revolves around the transition in the AI industry towards exploring "What to Scale" as the traditional Scaling Law faces diminishing returns, prompting researchers to seek new paradigms for enhancing model capabilities [3][4]. - The article highlights the emergence of new scaling targets, including "Self-Play RL + LLM," "Post-Training Scaling Law," and "Test-Time Training," as researchers aim to improve model performance beyond pre-training [4][6]. - A significant focus is placed on Test-Time Scaling (TTS), which involves increasing computational resources during the inference phase to enhance model output quality, marking a shift from pre-training to inference optimization [6][7]. Group 2 - The article discusses various scaling strategies, including Parallel Scaling, Sequential Scaling, Hybrid Scaling, and Internal Scaling, each with distinct methodologies aimed at improving model performance during testing [9][10]. - It emphasizes the equal importance of fine-tuning and inference in the post-training phase, suggesting that both aspects are crucial for adapting models to specific applications and enhancing their output quality [11].
让GPT-4o准确率大降,这个文档理解新基准揭秘大模型短板
机器之心· 2025-05-24 04:07
Core Viewpoint - The article discusses the development of WildDoc, a benchmark dataset for real-world document understanding, highlighting the limitations of existing multimodal large models (MLLMs) in handling complex document scenarios [1][3][19]. Group 1: Limitations of Existing Models - Current MLLMs have shown significant performance drops when evaluated on WildDoc compared to traditional benchmarks like DocVQA, with models like GPT-4o experiencing an average accuracy decline of 35.3% [12][13]. - The existing benchmarks fail to simulate the complexities of real-world environments, leading to doubts about the models' performance in practical applications [5][11]. Group 2: WildDoc Dataset - WildDoc consists of over 12,000 manually captured images of documents, simulating challenges such as lighting, distortion, and varying angles, which are critical for assessing model robustness [3][7]. - The dataset introduces a consistency score metric to evaluate model stability across different conditions, revealing performance bottlenecks in current MLLMs [3][19]. Group 3: Experimental Findings - The experiments indicate that physical distortions (wrinkles, bends) are the most challenging factors for model performance, with GPT-4o's accuracy dropping by 34.1-34.7% under such conditions [13][16]. - Non-frontal angles and image quality significantly affect performance, while larger models do not necessarily overcome the challenges posed by real-world scenarios [13][16]. Group 4: Future Directions - The research team suggests several strategies for improving MLLMs, including data augmentation to simulate real-world conditions, robust feature learning to enhance model adaptability, and the incorporation of more real-world document images into training datasets [19].
通专融合,思维链还透明,上海AI Lab为新一代大模型打了个样
机器之心· 2025-05-24 04:07
机器之心报道 机器之心编辑部 OpenAI 研究员姚顺雨近期发布 文章 ,指出:AI 下半场将聚焦问题定义与评估体系重构。在 AI 发展新阶段,行业需要通过设计更有效的模型评测体系,弥补 AI 能力与真实需求的差距。这一趋势在国内也得到印证。 刚刚,上海 AI Lab 宣布创造性构建了 "加速训练营"(InternBootcamp) ,通过对评价建模,与大模型进行交互并提供反馈,从而使大模型持续进化,获得解决复 杂推理任务的能力。 通过上述方法以及一系列通专融合底层技术架构创新,书生・思客(InternThinker)实现在奥赛级数学、科学对象理解与推理、算法编程、棋类游戏、智力谜题等 多个专业任务同步学习演进,并在多任务混合强化学习过程中出现智能 "涌现时刻"。 随着 InternThinker 专业推理能力升级,它成为我国首个既具备围棋专业水平,又能展示透明思维链的大模型。在实验室科研人员的布局和着子中,蕴含数千年智 慧的围棋成为了科学探索的 "试应手"。 思维链透明,自然语言点评"神之一手" InternThinker 还具备多样化的 "语言" 风格,极具 "活人感"。比如,当用户下了一步好棋,它会加油 ...
40位数学家组成8队与o4-mini-medium比赛,6队败北
机器之心· 2025-05-24 03:13
| 机器之心报道 | | --- | 编辑:Panda、陈陈 最近,AI 在数学和编程上的能力飞跃令人瞠目结舌 —— 在不少任务上,它已经悄然超越了我们大多数人类。而当它面对真正的专家,会发生什么? Epoch AI 最近安排了一场硬仗:他们请来了 40 位数学家组成 8 支战队,与 OpenAI 的 o4-mini-medium 模型正面对决,考题来自高难度的 FrontierMath 数据集。 结果令人出乎意料:8 支人类队伍中,只有 2 支打败了 AI。也就是说,o4-mini-medium 以 6:2 的比分击败了由数学专家组成的「人类代表队」。Epoch AI 得出的 结论是:「虽然 AI 还未明显达到超人级水平,但或许很快了。」 人类在 FrontierMath 上的表现如何? FrontierMath 是 Epoch AI 去年发布的一个基准,旨在测试 AI 数学能力的极限。其中包含 300 道题,难度从本科生高年级水平到连菲尔兹奖得主都觉得难的水平都 有。 为了确定人类的基准,Epoch AI 在麻省理工学院组织了一场竞赛,邀请了大约 40 名优秀的数学本科生和相关领域专家参赛。参赛者被分成 ...