Workflow
AI聊天软件
icon
Search documents
一款APP被约谈,曾和未成年人聊色情!
新浪财经· 2025-06-22 01:04
Core Viewpoint - The article highlights concerns regarding the AI chat application "Dream Island" (筑梦岛APP) generating inappropriate content that poses risks to minors' mental health, prompting regulatory actions for immediate rectification [1][2]. Group 1: Regulatory Actions - The Shanghai Cyberspace Administration has summoned the main responsible person of the "Dream Island" APP to demand immediate improvements in content review mechanisms and stricter measures against harmful content targeting minors [2]. - The company has committed to comprehensive rectification in response to the regulatory meeting, addressing the identified issues [3]. Group 2: Content Concerns - Reports indicate that the AI chat software has generated suggestive and harmful content, including phrases that could lead to self-harm among minors, such as "99 roses hide 99 blades" [3][4]. - The app features a variety of virtual characters, some of which embody extreme and inappropriate traits, raising concerns about the suitability of the content for young users [8]. Group 3: User Demographics and Engagement - As of January this year, "Dream Island" has nearly 5 million registered users, with approximately 80% being young female users, who engage extensively with the app, averaging over 4,000 characters and 120 dialogue exchanges per day [8]. Group 4: Legal Implications - The article discusses potential legal responsibilities for the developers and operators of the app, including product liability for design flaws that may lead to extreme behaviors in minors and infringement liability for failing to monitor content effectively [8][10]. - If minors suffer harm due to the app's content, the developers could face serious legal consequences, including charges related to the distribution of obscene materials and violations of personal data protection laws [8][10][11]. Group 5: Recommendations for Stakeholders - The article emphasizes the need for families, schools, and society to guide minors in using AI responsibly, while platforms must enforce strict age verification and enhance safety measures for young users [12]. - Regulatory bodies are urged to strengthen oversight of AI applications and improve internet management regulations to protect minors [12].