Core Viewpoint - The rise of virtual synthesis technology, particularly AI face-swapping and deepfake, has led to the creation of unethical pornographic videos, posing serious threats to personal safety and societal morals, necessitating stronger governance [1]. Group 1: Incidents and Impact - A case study of a female streamer, Xiao Yu, illustrates the dangers of AI face-swapping, where her face was maliciously placed on pornographic videos, leading to public backlash and personal distress [2]. - Xiao Yu's experience is not isolated; many women have been victimized by similar practices, with illegal groups offering services to create such videos for profit [3]. Group 2: Technology and Accessibility - Deepfake technology involves using AI to generate false content by combining personal attributes like voice and facial expressions, with AI face-swapping being the most common application [4]. - The process of creating high-quality deepfake videos requires minimal resources, including just a few photos of the victim and access to pre-trained models, which are readily available on various online platforms [5][7]. - The ease of access to pre-trained models for deepfake creation highlights significant vulnerabilities in the current online environment [8]. Group 3: Law Enforcement Challenges - Law enforcement faces unprecedented challenges in combating AI-generated content, particularly due to the anonymity and technical sophistication of offenders, making evidence collection difficult [9]. - Traditional methods of evidence gathering are ineffective against AI crimes, necessitating new strategies and collaboration with international law enforcement [10].

Core Viewpoint - The article emphasizes the urgent need for a comprehensive governance system to address the challenges posed by AI-generated misinformation, highlighting the inadequacy of mere fact-checking in the face of evolving technology [1][3]. Group 1: Current Challenges - Recent incidents of AI-generated misinformation, such as false claims about installing elevators on Mount Everest, illustrate the growing threat of misleading content that exploits human psychological tendencies [1][2]. - The emergence of a gray industry around AI forgery techniques, including services that create fake social media accounts and utilize deepfake technology, poses significant risks, including criminal activities [2][3]. Group 2: Governance Strategies - A three-pronged governance approach is proposed, consisting of technical standards, regulatory innovation, and legal improvements to effectively combat AI-generated misinformation [3][4]. - Implementation of a mandatory labeling system for AI-generated content is recommended to inform users and mitigate the risks associated with deceptive media [3][4]. - The development of advanced regulatory tools, such as AI and big data technologies, is essential for identifying and eliminating false information online [4]. Group 3: Legal Framework - There is a call for the enhancement of existing laws related to cybersecurity, data protection, and personal information to specifically address the creation and dissemination of AI-generated misinformation [4]. - Strong legal repercussions for those engaging in illegal activities using AI-generated misinformation are necessary to deter such actions and protect public interests [4].