大模型数据安全

Search documents
蚂蚁集团大模型数据安全总监杨小芳:用可信AI这一“缰绳”,驾驭大模型这匹“马”
Mei Ri Jing Ji Xin Wen· 2025-06-09 14:42
Core Viewpoint - The rapid development of AI technology presents significant application potential in data analysis, intelligent interaction, and efficiency enhancement, while also raising serious security concerns [1][2]. Group 1: Current AI Security Risks - Data privacy risks are increasing due to insufficient transparency in training data, which may lead to copyright issues and unauthorized access to user data by AI agents [3][4]. - The lowering of security attack thresholds allows individuals to execute attacks through natural language commands, complicating the defense against AI security threats [3][4]. - The misuse of generative AI (AIGC) can lead to social issues such as deepfakes, fake news, and the creation of tools for cyberattacks, which can disrupt social order [3][4]. - The long-standing challenge of insufficient inherent security in AI affects the reliability and credibility of AI technologies, potentially leading to misinformation and decision-making biases in critical sectors like healthcare and finance [3][4]. Group 2: Protective Strategies - The core strategy for preventing data leakage in both AI and non-AI fields is comprehensive data protection throughout its lifecycle, from collection to destruction [4][5]. - Specific measures include scanning training data to remove sensitive information, conducting supply chain vulnerability assessments, and performing security testing before deploying AI agents [5][6]. Group 3: Governance and Responsibility - Platform providers play a crucial role in governance by scanning and managing AI agents developed on their platforms, but broader regulatory oversight is necessary to ensure effective governance across multiple platforms [7][8]. - The establishment of national standards and regulatory policies is essential for monitoring and constraining platform development, similar to the regulation of mini-programs [7][8]. Group 4: Future Trends in AI Security - Future AI security development may focus on embedding security capabilities into AI infrastructure, achieving "security by design" to reduce costs associated with security measures [15][16]. - Breakthroughs in specific security technologies could provide ready-to-use solutions for small and medium enterprises facing AI-related security risks [15][16]. - The importance of industry standards is emphasized as they provide a foundational framework for building a secure ecosystem, guiding technical practices, and promoting compliance and innovation [17][18].