Group 1 - A woman in Qingdao reported being defamed by AI-generated fake explicit videos, leading to a police report [1] - The misuse of deepfake and similar technologies has given rise to a black market for such services [1][2] - A previous incident involved a woman in Guizhou whose live-streamed image was altered to create a nude photo, resulting in the arrest of the perpetrator [2] Group 2 - AI technologies for face and clothing alteration have become highly advanced, enabling the creation of realistic images and videos [3] - Detection methods for identifying fake images include analyzing inconsistencies in lighting and unnatural deformations, though these methods are not foolproof [3] - Regulatory bodies and platforms are working to enhance public awareness and detection capabilities regarding AI-generated content [3]

近日，青岛保时捷销售中心的牟女士自称，近期发现由AI恶意合成的虚假、不良视频，对其进行诽谤 和侮辱，"这些视频百分之百是伪造的"，并表示"对造谣者宣战"。10月11日，青岛市李沧区虎山路派出 所工作人员向南都N视频记者确认，牟女士已在虎山路派出所报警。 采写：见习记者 付冰洁 南都N视频记者 韦娟明 10月10日，牟女士通过社交平台公布了自己在派出所的照片，配文称，网络上出现大量利用AI技术恶 意合成的虚假视频以及跟面部侧脸局部相似的不良视频，对她进行诽谤和侮辱，甚至肆意传播，泄露她 的电话以及微信号，已对其正常生活造成了严重的影响，其已委托相关律师团队对此次事件进行全面的 证据保全和公证。"这些视频百分之百是伪造的，由不法分子通过非法手段制作。" 公开资料显示，牟女士曾于2023年、2024年连续两年卖出170台保时捷，两次成为保时捷年度销冠。今 年9月，她再度成为保时捷月度销冠，登上热搜第一。 牟女士补充说，她已向当地公安机关报案，坚决追究所有涉案人员的民事及刑事责任，并悬赏征集有效 线索，"我恳请大家，不观看、不下载、不传播这些违法内容，并积极举报"。对于提供关键证据、帮助 锁定主要传播源头的线索，她称 ...

"大家好，我是婵宝，叔叔阿姨可以下单试试""我是全红婵哥哥全进华，为大家准备了2000单的蜂蜜，16块9发两斤"……近期，社交平台上多个账号利用全 红婵及其家人声音合成AI视频为商品带货。对此，全红婵的家人明确表示均系伪造视频，不少消费者听闻直呼上当。 in town of controller L ▲ l 7 / t 1 随着AI合成技术发展，仿冒名人明星虚假带货频频出现。这些不法商家利用公众对名人明星的情感投射和信任心理，为博流量通过AI技术生成以假乱真的 带货视频，或张冠李戴，或无中生有，或故弄玄虚，手法多端、套路变换，既没有真假底线，也没有对法律的敬畏，目的就是收割消费者。 AI合成名人明星虚假带货，与AI虚假营销乱象背后的黑产链条密切相关。一些利用AI新技术实施的虚假宣传中，往往存在同一产品链接跳转至不同网店的 情况。加之AI技术造假成本低，让批量炮制、快速传播、随时换壳的欺诈营销容易得逞，陷入"造假-流量-变现-更多造假"的恶性循环。此外，短视频平台对 一些账号的入驻资质、带货视频内容等审核流于形式，冒用账号取证难、追责难，也为AI虚假营销的蔓延"推波助澜"。 技术理应向上向善，AI合成技术的使用 ...

Core Viewpoint - The rise of AI-generated content has led to the proliferation of misleading information, particularly in health and wellness sectors, prompting platforms like Xiaohongshu to take action against such abuses [1][4][6]. Group 1: AI Content Generation and Misleading Information - AI technology is being misused to create deceptive videos featuring public figures, which can mislead viewers into believing false health claims [2][3]. - Many of these AI-generated videos mix real scientific information with fabricated content, making it difficult for the average viewer to discern the truth [3][4]. - The use of AI in generating content has raised concerns about "information pollution," which can undermine public trust and health decisions [4][5]. Group 2: Regulatory and Platform Responses - Xiaohongshu has initiated a crackdown on accounts that misuse AI to generate false content, banning 13 accounts and removing 265 pieces of misleading content [6][7]. - The platform is responding to government directives aimed at creating a healthier online environment by enhancing its content monitoring capabilities [6][7]. - Legal experts emphasize the need for clear identification of AI-generated content to protect users from misinformation and uphold platform integrity [5][8]. Group 3: Industry Challenges and Recommendations - The rapid advancement of AI technology poses challenges for content verification, as many misleading videos evade detection due to sophisticated generation techniques [5][8]. - There is a call for social media platforms to implement AI content labeling mechanisms and for the public to improve media literacy to better evaluate the credibility of online information [8].

Group 1 - The news discusses the unverified claim that Olympic champion Quan Hongchan's family is building a new house, which has gained attention on social media [1] - Multiple accounts have emerged on social media using AI-generated voices of Quan Hongchan and her family to promote the house construction, aiming to attract traffic [1] - The AI-generated videos include links to various products such as camel milk powder and local eggs, leading to instances of users being scammed into making purchases [4] Group 2 - Quan Hongchan's parents rely on fruit farming for their livelihood, and her brother, Quan Jinhua, is a rural live-streaming host promoting local agricultural products [6] - Quan Jinhua aims to support local farmers and address issues of fruit oversupply and market fluctuations through his social media efforts [6][7] - In 2024, Quan Jinhua has publicly urged people to identify and report fake accounts on social media [7] Group 3 - Several celebrities have previously been victims of AI-generated impersonations, raising concerns about the misuse of technology [10] - Legal experts highlight that unauthorized use of someone's likeness or voice through AI constitutes an infringement of rights under Chinese law [11] - Recent regulations require clear identification of AI-generated content to prevent the spread of misleading information [12]

Group 1 - The incident involving the family of Olympic champion Quan Hongchan highlights the misuse of AI technology, where synthetic voices of family members were used for commercial purposes without authorization, constituting violations of personal rights [1][2] - The fraudulent activities not only deceive consumers but also undermine trust in the authenticity of online information, potentially impacting the entire short video platform market [2] - AI synthesis technology presents a dual challenge, enhancing information production efficiency while complicating the identification of false information, thus increasing regulatory difficulties [2] Group 2 - In response to the misuse of AI synthesis technology, the National Internet Information Office and other departments have introduced a regulation set to take effect on September 1, 2025, mandating clear identification of AI-generated content [3] - There is a call for stricter penalties for infringement to deter fraudulent activities, alongside the need for platforms to enhance their technical capabilities to identify and label AI-generated content [4] - Consumers are urged to develop discernment and caution against unverified information, emphasizing the importance of a regulated application of AI technology to foster a trustworthy online environment [4]