组相对策略优化(GRPO)算法
Search documents
DeepSeek登《Nature》封面,梁文锋带队,首次回应“蒸馏”争议
Feng Huang Wang· 2025-09-18 06:17
Core Insights - The article highlights a significant achievement in China's AI sector with the publication of the DeepSeek-R1 model, which demonstrates a breakthrough in reducing the cost of training large language models while enhancing their reasoning capabilities [1][10]. Cost Efficiency - DeepSeek-R1's inference cost is remarkably low at $294,000, which is significantly less than the estimated $100 million spent by OpenAI on GPT-4 and the tens of millions by other tech giants [6]. - Even when including the approximately $6 million for the foundational model training, the total cost remains substantially lower than that of international competitors [6]. Methodological Innovation - The research team employed a pure reinforcement learning framework and introduced the Group Relative Policy Optimization (GRPO) algorithm, rewarding the model based solely on the correctness of final answers rather than mimicking human reasoning paths [6][10]. - This unconventional training approach led to the emergence of advanced behaviors such as self-reflection and self-verification, allowing the model to generate extensive reasoning chains [7]. Performance Metrics - DeepSeek-R1-Zero achieved an impressive accuracy rate of 77.9% in the American Mathematics Invitational Exam (AIME 2024), which further improved to 86.7% with self-consistency decoding, surpassing the human average [7]. - The model's performance extends beyond mathematics and programming tasks, demonstrating fluency and consistency in writing and question-answering tasks [7]. Leadership and Vision - The success of DeepSeek-R1 is attributed to the leadership of Liang Wenfeng, who has a background in machine learning and a vision for AI's transformative potential [8]. - Liang's approach to team building emphasizes capability over experience, focusing on nurturing young talent to drive innovation [9]. Industry Implications - The research represents a methodological declaration that emphasizes a sustainable path for AI evolution, moving away from reliance on vast labeled datasets and high funding barriers [10]. - The competition in AI is expected to shift from a focus on data and computational power to one centered on algorithmic and intellectual innovation, with DeepSeek-R1 setting the stage for this new era [11].