价值函数
Search documents
llya最新判断:Scaling Laws逼近极限,AI暴力美学终结
3 6 Ke· 2025-11-26 08:46
Core Insights - Ilya Sutskever, co-founder of OpenAI and a key figure in deep learning, has shifted focus from scaling models to research-driven approaches in AI development [1][2][3] - The industry is moving away from "scale-driven" methods back to "research-driven" strategies, emphasizing the importance of asking the right questions and developing new methodologies [2][3] - Sutskever argues that while AI companies may experience stagnation, they can still generate significant revenue despite reduced innovation [2][3] - The potential for narrow AI models to excel in specific domains suggests that breakthroughs may come from improved learning methods rather than merely increasing model size [3][4] - The emergence of powerful AI could lead to transformative societal changes, including increased productivity and shifts in political and governance structures [3][4] - Sutskever emphasizes the importance of aesthetic principles in research, advocating for simplicity and elegance in AI design [4] Industry Trends - The scaling laws that dominated AI development are nearing their limits, prompting a return to foundational research and exploration [2][28] - The current phase of AI development is characterized by a shift from pre-training to reinforcement learning, which is more resource-intensive [29][30] - The distinction between effective resource utilization and mere computational waste is becoming increasingly blurred in AI research [30][31] - The scale of computational resources available today is substantial, but the focus should be on how effectively these resources are utilized for meaningful research [42][44] Company Insights - Safe Superintelligence (SSI) has raised $3 billion, positioning itself to focus on foundational research without the pressures of market competition [45][46] - SSI's approach to AI development may differ from other companies that prioritize immediate market applications, suggesting a long-term vision for advanced AI [45][46] - The company believes that the true value lies not in the sheer amount of computational power but in the strategic application of that power to drive research [43][44]
Scaling时代终结了,Ilya Sutskever刚刚宣布
机器之心· 2025-11-26 01:36
机器之心报道 机器之心编辑部 「Scaling 时代已经终结。」 当这句话出自 Ilya Sutskever 之口时,整个 AI 社区都无法忽视。作为 Safe Superintelligence Inc. 的创始人,他在最新访谈中抛出的这 一断言,不仅令业内震惊,更收获了诸多重量级人物的共鸣。 这场由 Dwarkesh Patel 主持、长达 95 分钟的深度对话,上线短短数小时便在 X 平台上突破了百万浏览量。从大模型的技术现状到 研究品味,再到对超级智能的终极构想,Ilya 毫无保留。 以下是本次访谈的精华总结,带你读懂这位顶尖科学家的判断与展望。 视频地址:https://www.dwarkesh.com/p/ilya-sutskever-2 1. 模型能力的「参差不齐」(Model Jaggedness) 与泛化 现象: Ilya 指出当前模型存在一种奇怪的矛盾 —— 它们能在高难度的评测(Evals)中表现出色,却可能在简单的任务上反复 犯错(如修 Bug 时引入新 Bug)。 解释: 他认为这可能源于「奖励黑客行为」(Reward Hacking)。人类研究员为了让评测分数好看,过度针对评测集进 ...