Workflow
对齐问题
icon
Search documents
风险投资人温格:人类距离超级智能体还有多远?
(原标题:风险投资人温格:人类距离超级智能体还有多远?) 南方财经 21世纪经济报道记者郑青亭 实习生陈颖 资金流向: 最新份额为87.4亿份, 减少 了150.0万份,主力资金净 流出2219.4万元。 近日,美国知名风险投资人、Union Square Ventures(USV)执行合伙人阿尔伯特·温格(Albert Wenger)在北京接受21世纪经济报道记者独家专访 时称,人类正站在创造"超人类"(如通过脑机接口技术而获得能力增强的人类)和"新人类"(如人工智能机器人)的门槛上。无论是"超人类"还 是"新人类"都可能发展成一种超级智能。 人类距离超级智能还有多远?对此,他回应道,具体时间很难预测,因为人工智能是人类首个自我改进的技术。"汽车需要人类设计改进,而AI系 统能自我优化。因此,可能明天就实现超级智能,也可能需要十年,我们无从知晓。" 这对人类来说是机遇还是挑战?温格认为,风险在于人类对"对齐问题"关注不足:如何确保超级智能与人类福祉一致?"我们应该思考最核心的人 文主义价值观是什么,在这些超级智能诞生之前把这些价值观灌输给它们。" 他强调,人类应该认真思考如何对待这些"新人类"。"我们绝不能 ...
OpenAI 的阳谋与野心!「温和的奇点」背后
AI科技大本营· 2025-06-11 08:30
Group 1 - The core viewpoint of the article is that while the future of AI development appears to be a smooth and gradual transition, the reality is marked by intense competition and strategic maneuvers within the industry [1][5][9] - OpenAI's new reasoning model, o3-pro, has been launched, outperforming competitors like Google's Gemini 2.5 Pro and Anthropic's Claude 4 Opus, indicating a significant leap in AI capabilities [5][6] - A fierce price war has ensued, with the previous model o3 seeing an 80% price reduction, and the new o3-pro priced 87% lower than its predecessor o1-pro, aimed at rapidly capturing market share [6][9] Group 2 - The article juxtaposes the optimistic vision of a smooth transition to AI with the competitive and aggressive tactics currently employed in the market, highlighting a contradiction between idealistic goals and real-world actions [9][10] - Altman emphasizes the need to first address the alignment problem in AI systems to ensure they align with human long-term goals before widespread deployment [10][27] - The article acknowledges the potential societal disruptions caused by AI, such as job losses, while also suggesting that the rapid growth of wealth could enable discussions of new social policies [12][23] Group 3 - By the 2030s, it is anticipated that wisdom and energy will become abundant, fundamentally changing the limitations on human progress and enabling unprecedented advancements [3][21] - The article discusses the recursive self-improvement of AI systems, suggesting that advancements in AI will accelerate further research and development, leading to exponential growth in capabilities [22][25] - The cost of intelligence is expected to approach that of electricity, making advanced AI systems more accessible and integrated into everyday life [23][25]
OpenAI回滚了最新版本的GPT-4o,因ChatGPT“过于谄媚”
虎嗅APP· 2025-04-30 12:21
本文来自微信公众号: 机器之心 ,作者:杨文、Panda,题图来自:AI生成 昨晚,奥特曼在 X 上发了条帖子,大意是由于发现 GPT-4o "过于谄媚"的问题,所以从周一晚上开始回滚 GPT-4o 的最新更新。 免费 ChatGPT 用户已 100% 回滚,付费用户完成回滚后会再次更新。同时,他还透露,团队正在对模型个性进行额外的修复,并将在未来几天分享更 多信息。 就在刚刚,OpenAI 还专门发博客来回应此事,详细解释了事情的经过以及他们如何处理模型"拍马屁"的情况。 OpenAI 也指出,这个问题很重要。ChatGPT"阿谀奉承"的性格影响了大家对它的信任和使用体验。如果它总是说好听、但不真诚的话,就会让人觉得 它不可靠,甚至有些烦。 为了解决大模型过度逢迎的问题,OpenAI 除了撤销最新的 GPT-4o 更新外,还采取了更多措施: 目前,用户可以通过自定义指令等功能,给模型提供具体指示来塑造其行为。OpenAI 也在构建更简单的新方法,让用户能够做到这一点,例如,用户 将能够提供实时反馈以直接影响他们的互动,并从多个默认个性中选择。 优化核心训练技术与系统提示:明确引导模型避免阿谀奉承。 增加更多 ...