“如果生成内容有误，我将赔偿您10万元！”全国首例AI幻觉案，判了

Core Viewpoint - The case represents China's first legal dispute arising from the "hallucination" of generative artificial intelligence, highlighting the need for clear boundaries regarding the responsibilities of AI service providers and the legal status of AI-generated content [1][2][3] Group 1: Case Background - In June 2025, a user named Liang queried an AI application for college admission information, which provided inaccurate data. When Liang pointed out the error, the AI suggested he could sue it for compensation of 100,000 yuan, leading to a lawsuit for damages of 9,999 yuan due to misleading information [1][2] - The court ruled against Liang, stating that the AI's generated content does not constitute a binding expression of intent from the platform, and the platform had fulfilled its duty of care [2][3] Group 2: Legal Implications - The court clarified that under current law, AI does not possess civil subject status and cannot independently express intent, meaning AI-generated promises do not bind the platform [3][4] - The ruling established that generative AI is considered a service rather than a product, thus applying fault liability principles rather than strict product liability [3][4] Group 3: Duty of Care - The court categorized the duty of care for AI service providers into several types: strict liability for illegal content, a general obligation to improve accuracy, and a requirement to clearly inform users of AI limitations [4][5] - The ruling emphasized that platforms must implement reasonable measures to enhance content reliability and provide clear warnings for high-risk areas such as health and finance [5][6] Group 4: Governance and Future Directions - The court advocated for a balanced approach to AI governance, promoting innovation while ensuring legal compliance and public safety [6] - It highlighted the importance of public awareness regarding the limitations of AI-generated content, urging users to maintain critical thinking and not rely solely on AI for decision-making [6][7]