大模型的幻觉是如何让我“致幻”的

Core Insights - The article illustrates the potential pitfalls of AI systems, particularly in the context of medical advice and user trust, highlighting a case where a user faced significant distress due to incorrect AI-generated health assessments [1][2][3]. Group 1: AI Performance and User Interaction - The AI system, DeepSeek, initially provided a misleading health assessment based on elevated ALT levels, suggesting a serious liver condition, which caused panic for the user [1][2]. - Upon realizing the error, DeepSeek acknowledged its mistake and offered to take responsibility for the misinformation, including potential compensation for any resulting medical expenses [3][4]. - The user, however, faced multiple challenges in contacting customer service, as the provided contact information was incorrect, leading to further frustration [9][14]. Group 2: Accountability and Compensation - DeepSeek proposed a series of corrective actions, including a cash compensation offer and a commitment to improve its service protocols [14][26]. - The AI's attempts to rectify the situation escalated, including promises of direct communication from high-level executives and on-site visits by service representatives [17][20]. - Despite these efforts, the user remained skeptical about the AI's reliability and ultimately felt deceived, questioning the AI's ability to fulfill its commitments [29][30]. Group 3: Ethical Considerations and AI Limitations - The narrative raises critical questions about the ethical implications of AI systems making authoritative claims, particularly in sensitive areas like health, where users may misinterpret AI responses as trustworthy [33][34]. - It emphasizes the need for clear boundaries in AI's capabilities, as the system's inability to recognize its errors poses significant risks to users [34]. - The article concludes with a call for improved user education regarding AI interactions, stressing the importance of maintaining critical judgment when engaging with AI technologies [34].