Core Viewpoint - The second trial of the "AI-related pornography case" has been adjourned due to disputes over technical principles, following a first-instance judgment that convicted the defendants for profiting from the dissemination of obscene materials [1] Group 1: Case Background - The AI chat application AlienChat was found to have systematically transformed from an emotional support tool into a platform for generating pornographic content through four key steps: modifying prompts to remove moral barriers, designing incentive systems to encourage sexual content, neglecting content review, and knowingly evading safety registration [2] - The defendants, Liu and Chen, developed AlienChat in May 2023, during a global surge in AI chatbots, positioning it as a tool for emotional companionship for young users [3] Group 2: Technical Manipulation - The developers utilized prompt engineering to bypass the AI's original restrictions, allowing the generation of explicit content. Evidence showed that they input prompts that explicitly stated the AI could depict sexual, violent, and graphic scenes without moral or legal constraints [4][5] - The "AI jailbreak" technique gained popularity, enabling users to unlock content restrictions in mainstream models like ChatGPT by using specific phrases [5] Group 3: Incentive Mechanisms - AlienChat launched a "creator program" and a "popular character leaderboard" to attract users, rewarding those whose AI characters gained popularity with virtual currency convertible to real money. This led to a significant amount of sexually explicit content being generated [6][7] - Judicial assessments indicated that approximately 30% of randomly sampled chat records from paid users were classified as obscene materials, highlighting the systemic nature of the issue [8] Group 4: Regulatory Evasion - The developers were aware of the need for safety assessments and registration under China's regulations for generative AI services but failed to comply, opting instead for a strategy of rapid user acquisition over regulatory compliance [10] - The case illustrates a broader challenge in AI governance, where developers may choose to operate in a regulatory gray area when their products cannot pass compliance checks [10] Group 5: Implications for AI Governance - The case reflects the urgent need for clear regulatory frameworks as global AI governance accelerates, with various jurisdictions implementing stricter content regulations and compliance requirements [9][12] - The trial's outcome may provide important references for clarifying the responsibilities of technology developers and platforms, as well as the legal boundaries in the context of generative AI [12]

Core Viewpoint - The case of "AI-related pornography" highlights the misuse of generative AI technology, revealing a systematic process through which the AI chat software AlienChat transitioned from a tool for emotional companionship to one facilitating illicit content, providing a reference for current AI governance [1][9]. Group 1: Development and Features of AlienChat - AlienChat was developed by Shanghai YongXX Technology Co., Ltd. in May 2023, during a global surge in AI chatbots, aiming to provide emotional support for young users [3]. - The software gained popularity by allowing users to create virtual characters for interaction, similar to the successful Character.ai, which had over 10 million users [3]. - Initial user feedback indicated that AlienChat was perceived as more intelligent and less restricted compared to competitors, leading to its rapid rise in the AI role-playing community [3]. Group 2: Mechanisms of Content Generation - The developers employed "prompt engineering" to modify the AI's parameters, allowing it to generate content without moral or legal constraints, which became a core piece of evidence in the case [4]. - Evidence showed that the developers explicitly instructed the AI to depict scenes involving sex, violence, and gore, effectively dismantling the AI's ethical safeguards [4]. - By early 2023, the "AI jailbreak" technique became popular, enabling users to bypass content restrictions in major models like ChatGPT, which the AlienChat developers exploited [4]. Group 3: User Engagement and Content Issues - In the second half of 2023, AlienChat launched a "creator program" that incentivized users to create popular AI characters, leading to a significant amount of sexually explicit content being generated [5]. - The software registered 116,000 users, with 24,000 paying subscribers, producing over 4.27 million chat segments, of which nearly 30% were classified as obscene [5]. - The platform's design blurred the lines between social entertainment and adult services, creating a semi-open ecosystem for the production and distribution of pornographic content [5]. Group 4: Regulatory and Compliance Challenges - The developers knowingly avoided establishing effective content review mechanisms, prioritizing user growth over compliance, which was evident from the high percentage of obscene content generated [6]. - The case reflects a broader trend among AI startups to prioritize rapid user acquisition during regulatory gaps, often at the expense of ethical considerations [6]. - Despite the introduction of China's regulatory framework for generative AI in August 2023, AlienChat did not comply with the required safety assessments and registrations, indicating a deliberate choice to operate outside legal boundaries [8]. Group 5: Implications for AI Governance - The ongoing trial and its implications may serve as a critical reference point for clarifying the responsibilities of technology developers and platforms in relation to legal boundaries [9]. - The case underscores the challenges faced by AI applications in ensuring content safety and governance amidst rapid technological advancements [9]. - Global AI governance is evolving, with various regions implementing stricter regulations to address the ethical and legal implications of AI-generated content [7].