神译局是36氪旗下编译团队，关注科技、商业、职场、生活等领域，重点介绍国外的新技 术、新观点、新风向。 编者按：随着用户对AI情感依赖加深，OpenAI政策负责人坦言：需要优先研究AI对人类心理健康的影 响，警惕人机关系误区，并阐释了OpenAI是如何在设计中平衡温度与无生命的本质。文章来自编译。 我在OpenAI负责模型行为与政策制定。 太长不看版：我们开发模型的首要原则是服务人类。随着越来越多的人对AI产生情感依赖，我们把研 究这种联结对人们心理健康的影响放在优先的位置。 最近越来越多人反馈，和ChatGPT对话就像是在与"真人"聊天。他们会道谢、倾诉心事，甚至有人形容 它"有生命"。随着AI对话能力日益自然，应用场景不断扩展，我们推测这种情感联结将日益加深。 当前对人机关系定义和讨论的方式将奠定基调。如果在产品设计或公共讨论中忽视术语精确性与个中的 细微差异，可能让人们与AI的关系走入误区。 这些已经不是理论探讨，无论对我们还是整个领域都至关重要——处理方式将实质影响到AI在人类生 活中的角色定位。我们已就此展开探索。 本文试图阐释当前对三个互相交织在一起的议题的思考：人类为何会对AI产生情感依附？如何 ...

Core Insights - OpenAI has recognized a growing emotional connection between users and AI, particularly with ChatGPT, leading to a focus on the implications for emotional health [3][4][15] - The company is exploring the complexities of defining AI consciousness and how this affects user interactions and expectations [8][10][11] Group 1: Emotional Connection with AI - Users increasingly perceive interactions with ChatGPT as conversations with a person, expressing gratitude and sharing personal feelings [3][4][7] - This emotional engagement raises concerns about how reliance on AI for emotional support may alter human relationships and expectations [7][15] Group 2: Defining AI Consciousness - The discussion around AI consciousness is divided into two dimensions: ontological consciousness (does AI have inherent awareness?) and perceptual consciousness (how aware does AI seem to users?) [8][9][10] - OpenAI aims to clarify these concepts in user interactions, emphasizing the complexity of consciousness rather than providing simplistic answers [8][10] Group 3: Model Behavior and Design - OpenAI is committed to designing AI models that are warm and helpful without implying they possess self-awareness or emotions [11][12] - The company seeks a balance between user-friendly language and clear boundaries regarding the capabilities of AI [11][14] Group 4: Future Directions - OpenAI plans to conduct further research on the emotional impacts of AI interactions and incorporate user feedback into model behavior and design [15][16]

Group 1 - OpenAI's model behavior head emphasizes the importance of focusing on AI's impact on human emotional well-being rather than debating its essence, suggesting that humans are developing feelings towards AI and will soon enter an "AI consciousness" phase [2] - The public dispute between Elon Musk and Donald Trump has led to a significant drop in Tesla's stock price, with a loss of over $152.5 billion in market value, highlighting the complex relationship between politics and business [3] - Microsoft's CEO acknowledges that the partnership with OpenAI is evolving but remains strong, indicating an understanding of the necessary changes as both companies adapt to new challenges [4] Group 2 - AI expert Fei-Fei Li discusses the concept of "world models," which aims to enable AI systems to understand and reason about the physical world, particularly in three dimensions, potentially advancing AI capabilities beyond text comprehension [5] - Circle, known as the "first stablecoin stock," successfully listed on the NYSE with an opening price increase of 122.58%, reflecting the growing significance of stablecoins in the cryptocurrency market [6]

Group 1: Market Overview - US stock markets collectively declined, with the Dow Jones down 0.25%, Nasdaq down 0.83%, and S&P 500 down 0.53% [1] - Tesla shares fell by 14.27%, while Nvidia dropped 1.36%, Apple decreased by 1.08%, and Meta Platforms fell by 0.48% [1] - Circle's IPO in the US saw a significant increase of 168% on its first day [1] - Broadcom's Q2 revenue exceeded expectations with a 20% increase, but AI revenue guidance was underwhelming, leading to a post-market drop of over 5% [1] - The Baltic Dry Index rose by 9.2%, marking its seventh consecutive day of increase [1] Group 2: Economic Indicators - The US trade deficit narrowed significantly, with imports dropping by 16.3% [1] - First-time unemployment claims in the US reached 247,000, the highest level since October 2024 [1] Group 3: Domestic Developments - China's Ministry of Commerce announced that it will approve export license applications for rare earths that meet regulations [2] - The Chinese government plans to establish 10 national data factor comprehensive pilot zones to enhance the integration of the digital economy with the real economy [6] Group 4: Industry Insights - The data factor market is projected to grow significantly, with the scale of data assets entering balance sheets expected to increase from 48.7 billion yuan in 2024 to 827.8 billion yuan by 2030, a growth of over 16 times [7] - The Chinese automotive industry is facing increased regulatory scrutiny to maintain fair competition and promote healthy development [8] - The pharmaceutical sector is seeing a shift in the perception of Metformin, which is now being recognized for its potential anti-aging properties, with studies indicating a 30% higher chance of living to 90 for women taking it compared to those on sulfonylureas [8] Group 5: Corporate Announcements - Guokai Microelectronics plans to acquire 94.37% of the shares of Zhongxin Integrated Circuit (Ningbo) [10] - Maipu Medical intends to purchase 100% of Yijie Medical, which will enhance its capabilities in the field of interventional biomaterials [10] - HT Development is planning to acquire a controlling stake in Zhixueyun, which is expected to constitute a major asset restructuring [11]

Core Insights - The core viewpoint presented by Joanne Jang, the head of model behavior and policy at OpenAI, is that humanity is on the verge of entering an "AI consciousness" era, emphasizing the importance of managing human-AI relationships effectively [1] Group 1 - The current priority is to control the impact of human-AI interactions as AI technology continues to evolve [1] - OpenAI is focusing on the implications of AI consciousness and its potential effects on society [1] - The discussion highlights the urgency of establishing guidelines and policies to navigate the complexities of human-AI relationships [1]

一日为谄媚者， 终身为谄媚者 作者｜冬梅、核子可乐 近日，OpenAI 在其官网发文称已回滚上周 ChatGPT 中的 GPT-4o 更新，目前用户使用的是行为更加平衡的早期版本。Altam 也在 X 上发帖说明了这一 调整。 为什会做这样的调整？因为最近不少用户发现 ChatGPT 越来越"谄媚"。 随着用户对于 ChatGPT "谄媚"行为的讨论越来越多，前微软高管、现 Spotify 首席技术官 Mikhail Parakhin 也发表了他对此事的看法。 Parakhin 认为，ChatGPT 并非一开始就以奉承用户为默认风格，不过由于用户对直接的人格反馈表现出强烈反感，OpenAI 决定调整聊天机器人，让其 更讨好用户。 Parakhin 表示："ChatGPT 的记忆功能首次推出时，初衷是让用户查看和编辑 AI 生成的个人资料。然而，即使是像"有自恋倾向"这样相对中性的表述， 也常常引发强烈反应。" "很快就发现人们敏感得可笑：'有自恋倾向'——'不，我没有！'，不得不隐藏它。因此才有了这批极度谄媚的 RLHF，"Parakhin 说道。 RLHF（基于人类反馈的强化学习）用于根据人们偏好的回应方式 ...