Workflow
人工智能治理
icon
Search documents
为什么传统数据治理模式不再适用于人工智能/机器学习
3 6 Ke· 2026-01-26 07:32
Overview - The article discusses the inadequacy of traditional data governance in managing AI/ML systems, emphasizing the need for a shift towards AI governance frameworks that address the dynamic and probabilistic nature of these technologies [2][3]. Core Friction: Deterministic vs. Probabilistic - Traditional governance models are designed for static, structured data, assuming data can be managed through controlled creation, storage, access, and modification [4]. - AI governance must focus on the behavior of AI systems, which are dynamic and can interpret and infer information in non-programmatic ways, leading to risks even when underlying data is accurate [5]. Key Implementation Failure Points - The article identifies specific failure points in traditional governance when applied to AI systems, such as "vector blind spots" and "mosaic effects" [11]. - "Vector blind spots" occur when personal identifiable information (PII) is embedded in vector databases, making it invisible to traditional data loss prevention tools [12]. - The "mosaic effect" refers to the risk of AI models synthesizing information from fragmented data, potentially leaking sensitive information even when direct access is restricted [14]. - The "time freeze" issue highlights that AI models may operate on outdated information until retrained, leading to governance challenges [17]. Enhanced Governance Framework - The article proposes an "enhanced governance" framework that integrates existing data investments with new AI control standards, such as the NIST AI RMF and ISO 42001 [3][18]. - Key components of this framework include: 1. Input Governance: Protecting unstructured data before it interacts with models [19]. 2. Feature and Fairness Governance: Ensuring fairness and preventing implicit bias during feature transformation [20]. 3. Model Transparency Governance: Ensuring model decisions are interpretable and defensible [24]. 4. Model Governance: Treating models as black boxes requiring external validation [26]. 5. Model Lifecycle Governance: Monitoring model performance and managing concept drift [28]. Alignment with Industry Frameworks - The article emphasizes the necessity of transitioning from data-centric to model-centric governance, aligning with frameworks like NIST AI RMF and ISO/IEC 42001 [45][46]. - NIST highlights the importance of measuring trustworthiness features such as interpretability and fairness, which are often absent in traditional governance [46]. - ISO/IEC 42001 mandates continuous improvement and transparency, requiring organizations to document not only the data used but also the rationale behind parameter choices [47]. Conclusion - The future of AI governance lies in enhancing rather than replacing traditional data governance, focusing on behavior-driven governance models that ensure compliance and trust while fostering innovation [49].
2025年AI治理报告:回归现实主义
3 6 Ke· 2026-01-22 11:37
Core Insights - The global attitude towards AI has shifted from "apocalyptic fears" to focusing on "releasing real industrial potential" by 2025, indicating a significant change in governance priorities [1][3] Group 1: Macro Landscape - The Paris AI Action Summit in February 2025 marked a shift from "safety anxiety" to "innovation and action," reflecting a restructuring of global governance logic [2] - The EU is adjusting its regulatory approach by introducing the "Digital Omnibus" proposal to simplify rules and delay high-risk obligations to enhance industrial competitiveness [2] - The U.S. is moving towards deregulation, with the Trump administration's focus on a unified federal framework to eliminate barriers for the industry [2] - China emphasizes a pragmatic approach, balancing specific regulatory measures with an application-oriented strategy, creating a layered governance system [2] Group 2: Data Governance - The AI industry faces a structural shortage of high-quality data, leading to a search for synthetic data as a key solution [4] - Legislative efforts in the EU and Japan are establishing frameworks for "text and data mining," while U.S. court rulings are leaning towards recognizing the use of legally acquired books for training as "fair use" [4] - Future regulations may evolve beyond simple prohibitions to create a commercially viable mechanism for balancing rights and technological advancement [4] Group 3: Model Governance - The U.S. is shifting from comprehensive coverage to targeted regulation, exemplified by California's SB 53 law focusing on transparency for only a few large-scale models [7] - The EU's complex regulatory framework is facing challenges due to high compliance costs, prompting frequent legislative adjustments [7] - China's "scene slicing" strategy involves penetrating regulation across specific AI services, creating a governance system from data to application [7] - The rise of open-source models like DeepSeek-R1 is reshaping the global AI landscape, highlighting the importance of establishing a "safe harbor" for contributors [8] Group 4: Application Scenarios - The transition of AI from cloud to real-world applications raises new privacy challenges, particularly with intelligent agents that require extensive permissions [10] - AI's evolution into emotional companions introduces risks related to emotional dependency, prompting diverse regulatory approaches to protect vulnerable groups [10] - The struggle against deepfakes highlights the limitations of watermarking technologies, suggesting a focus on high-risk scenarios for precise governance [11] Group 5: Future Outlook - The discussion around AI consciousness and welfare is evolving from philosophical debates to scientific validation, indicating a potential need for governance frameworks that address AI as a rights-bearing entity [13]
健全人工智能前瞻型治理体系
Ke Ji Ri Bao· 2026-01-21 07:32
Core Viewpoint - The article emphasizes the need for modern governance of artificial intelligence (AI) to adapt to its unique characteristics, including self-learning and widespread impact, which necessitates a forward-looking and systematic governance framework [1][6]. Group 1: Current Governance Landscape - Recent efforts in China have focused on improving AI governance rules, particularly in areas like algorithm recommendation and generative AI, establishing clearer boundaries for governance [2]. - Local governments are accelerating the exploration of AI applications in digital governance, public services, and urban management, enhancing efficiency in areas such as regulatory enforcement and city governance [2][3]. - Despite progress, current governance remains reactive, primarily addressing issues after they arise, which limits its effectiveness as AI technology evolves rapidly [3][4]. Group 2: Identified Shortcomings - The existing governance approach is characterized by a delayed response to technological advancements, often intervening only after risks become apparent, leading to increased governance costs and limited flexibility [3][4]. - Governance tools are largely static, relying on policy documents that fail to monitor and adapt to the dynamic nature of AI systems, resulting in challenges in maintaining effective oversight [4]. - Current governance focuses heavily on risk prevention, lacking sufficient guidance on the developmental direction of AI technologies and their alignment with public interests [5]. Group 3: Recommendations for Modernization - To modernize AI governance, it is crucial to integrate governance requirements into the entire lifecycle of AI technology, shifting from reactive to proactive measures [6][7]. - Establishing a risk assessment mechanism that emphasizes forward-looking evaluations is essential to address the rapid evolution and impact of AI technologies [6][7]. - Setting clear operational boundaries and rules for AI systems is necessary to enhance their controllability and accountability from the outset [7][8]. - Governance should not only focus on risk prevention but also actively guide the development direction of AI, aligning it with public interests and enhancing governance effectiveness [8].
防止人工智能代理失控的五项操作准则
3 6 Ke· 2026-01-16 09:12
Core Insights - The article emphasizes the importance of a systematic and repeatable operational framework to ensure the reliability of autonomous agents in business environments, highlighting that theoretical governance structures often fail in practice due to execution gaps [2][3][20]. Group 1: Governance and Operational Framework - Companies are increasingly cautious about deploying autonomous agents, with predictions indicating that over 40% of such projects may be canceled due to cost overruns and poor risk management [2]. - Successful teams focus on establishing core operational norms that allow for early problem detection and systematic trust-building, preventing small deviations from escalating into larger issues [3][20]. Group 2: Key Operational Practices - **Weekly System Review**: Top teams conduct structured reviews before customer service operations, analyzing key performance indicators such as response deviation rate, 95th percentile latency, and cost per successful transaction [7]. - **Biweekly Failure Analysis Meetings**: These meetings involve rigorous analysis of near-miss incidents to trace back to the first erroneous reasoning step, utilizing a shared failure pattern log [10]. - **Weekly Calibration and Feedback Cycle**: Teams review ambiguous cases weekly to adjust decision thresholds, ensuring that high-cost or critical tasks are systematically optimized [11]. - **Daily Resilience Validation Tests**: Inspired by chaos engineering, teams integrate daily adversarial testing to verify system robustness against potential vulnerabilities [12]. - **Monthly Governance Review**: This review shifts focus from reactive crisis management to proactive risk prevention, assessing prevention metrics and discussing the advancement of autonomous boundaries [13][14]. Group 3: Success Metrics and Challenges - Evidence-based promotion standards require over 100 operations with a success rate exceeding 98%, and a core metric of autonomous success rate must remain above 0.95 for a month to indicate system maturity [15][16]. - Only 11% of organizations have successfully scaled autonomous agents into production environments, indicating a significant gap in maintaining operational rituals [18][19]. - The article outlines common implementation obstacles, such as neglecting failure analysis and misusing resilience testing, along with solutions to overcome these challenges [25][26]. Group 4: Cultural Shift and Future Outlook - The article advocates for a cultural shift from a builder mindset to a governance mindset, emphasizing the need for vigilance and metrics-driven approaches in managing AI systems [21][22]. - By 2028, 38% of organizations aim for AI agents to function as formal members of hybrid human-machine teams, indicating a trend towards collaborative productivity and innovation [21].
媒体+促个保向新!广东省网络数据安全与个人信息保护协会创新共治
Nan Fang Du Shi Bao· 2026-01-14 13:12
Core Viewpoint - The governance of the online ecosystem is a crucial task for building a strong network nation, impacting national development, security, and the interests of the people [1] Group 1: Policy and Regulation - A series of new regulations addressing privacy concerns have been implemented throughout 2025, indicating a stronger legal framework for personal information protection [3] - The "Network Data Security Management Regulations" came into effect on January 1, 2025, emphasizing the protection and regulation of personal information and important data [3] - The revised "Cybersecurity Law" integrates challenges related to artificial intelligence governance, further solidifying the legal foundation for data protection [3] Group 2: Organizational Initiatives - The Guangdong Provincial Network Data Security and Personal Information Protection Association was established in the summer of 2025, marking a national first in social organization for data security and personal information rights [2][6] - The association aims to connect government, industry, and the public, enhancing personal information protection awareness and compliance [6] - The association has organized numerous policy seminars and compliance training sessions to clarify boundaries and provide pathways for nearly a thousand institutions [7] Group 3: Community Engagement and Awareness - The Southern Metropolis Daily has actively engaged in compliance investigations, revealing issues such as mandatory facial recognition in hospitals and delivery services [9] - The media has transformed complex legal texts into accessible compliance tools, making it easier for the public to understand personal information protection principles [10] - Collaborative efforts have been made to establish a mechanism for regular communication on personal information protection among the Guangdong-Hong Kong-Macao Greater Bay Area [8]
为何全球关注超级人工智能(连线评论员)
Ren Min Ri Bao· 2026-01-09 01:22
Core Viewpoint - The rapid development of artificial intelligence (AI) raises concerns about the potential risks associated with superintelligent AI, prompting calls for a pause in its development from a significant number of scientists and industry leaders [1][2]. Group 1: Definitions and Distinctions - General AI is characterized by its high generalization ability, approaching human intelligence levels, and has broad application prospects [1]. - Superintelligent AI is defined as surpassing human intelligence in all aspects and potentially developing autonomous consciousness, leading to actions and thoughts that may be incomprehensible and uncontrollable by humans [1]. Group 2: Risks and Challenges - The primary risks associated with superintelligent AI include alignment failure and loss of control, where even minor deviations from human values could lead to catastrophic outcomes due to the amplification of these errors [2]. - The storage of negative human behaviors in network data increases the risk of superintelligent AI learning and replicating these behaviors, heightening concerns about alignment failure and loss of control [2]. Group 3: Governance and Safety Principles - Safety must be the foundational principle in the development of superintelligent AI, ensuring that security measures cannot be compromised for the sake of model performance [3]. - A proactive defense strategy is essential, focusing on continuous updates through an "attack-defense-assessment" process to address typical security issues like privacy breaches and misinformation [3]. Group 4: Global Cooperation and Governance - The development of superintelligent AI should not lead to a "arms race," and global cooperation is necessary to ensure its safety and reliability for all humanity [4]. - The establishment of international bodies, such as the "Independent International Scientific Group on AI" and the "Global Dialogue on AI Governance," is crucial for coordinating AI governance and promoting sustainable development [4][5]. - Countries, especially those with advanced technologies, have a responsibility to prevent reckless development of superintelligent AI that could lead to widespread risks [5].
从欧中合作谈到美国“退群” 牛津学者:重建互信才能推动全球治理
Xin Lang Cai Jing· 2026-01-01 09:28
Core Viewpoint - Global cooperation is essential despite challenges in traditional governance structures, and innovative collaboration methods are necessary to maintain a multilateral system [1][3]. Group 1: Global Cooperation - Sam Daws emphasizes the importance of global cooperation in addressing shared challenges such as climate change, biodiversity, health, food security, and conflict [2][4]. - There is a growing skepticism among some countries regarding the value of top-down legal frameworks, necessitating innovative approaches to multilateral cooperation [3]. Group 2: U.S. Withdrawal from Global Governance - The U.S. has withdrawn from several international agreements, including the Paris Agreement and the World Health Organization, which has significantly impacted global governance [4]. - Despite the U.S. withdrawal, many other UN member states continue to actively participate in international efforts, indicating that there is still much work to be done [4]. Group 3: Opportunities for China and Europe - Strengthening cooperation between China and Europe presents significant opportunities, including increased trade, joint actions on climate change, and collaborative efforts to prevent global health crises [6]. - China is recognized for its proactive role in international peacekeeping and conflict resolution, which can enhance cooperation with Europe in these areas [6].
1月新法新规:噪音扰民最高处十日拘留,个人取现超5万无需登记
新浪财经· 2026-01-01 07:42
Core Viewpoint - A series of new laws and regulations will take effect starting January 1, 2026, impacting various sectors including public security, taxation, education, electric vehicles, and cybersecurity [2]. Group 1: Public Security Regulations - The revised Public Security Administration Punishment Law will address issues such as animal attacks and noise disturbances, with penalties including up to ten days of detention and fines for severe cases [5][6]. - New provisions will allow for immediate penalties for dangerous behaviors like high-altitude object throwing and unauthorized drone flights, enhancing public safety measures [5]. - The law introduces a record sealing system for minor offenses, aligning with the principle of proportionality in law enforcement [6]. Group 2: Taxation Changes - The new Value-Added Tax (VAT) Law will come into effect, defining the scope of VAT for goods, services, and real estate transactions, with VAT being the largest tax category in China [7]. - In 2024, VAT revenue is projected to be approximately 6.57 trillion yuan, accounting for 38% of total tax revenue, with a 3.9% year-on-year increase noted in the first eleven months of 2025 [7]. Group 3: Cybersecurity and AI Regulations - The revised Cybersecurity Law will enhance monitoring and assessment of AI risks, supporting the development of AI technologies and ethical standards [11]. - Network operators will be required to maintain strict confidentiality of user information and allow users to request deletion or correction of their personal data [11]. Group 4: Housing and Real Estate - A new policy will impose a 3% VAT on individuals selling homes purchased for less than two years, while those selling homes held for two years or more will be exempt from VAT [17]. Group 5: Electric Vehicle Standards - A mandatory standard for electric vehicle energy consumption will be implemented, tightening limits by approximately 11% compared to previous recommendations, which will require technical upgrades from manufacturers [16]. Group 6: Digital Currency Developments - Starting January 1, 2026, digital yuan wallets will begin to accrue interest, marking a transition to a digital deposit currency system [18]. Group 7: Environmental Regulations - The production of mercury-containing thermometers and blood pressure monitors will be banned to comply with international environmental agreements [19]. Group 8: Financial Regulations - New regulations will eliminate the requirement for individuals to register the source of cash withdrawals exceeding 50,000 yuan, allowing banks to assess risk before questioning customers [21].
1月新法新规:噪音扰民最高处十日拘留,个人取现超5万无需登记
Xin Lang Cai Jing· 2026-01-01 00:15
Group 1: Law and Regulation Changes - The revised Public Security Administration Punishment Law will regulate issues such as animal attacks and noise disturbances, with penalties including up to ten days of detention and fines of up to 1,000 yuan for severe noise disturbances [2] - The new Value-Added Tax (VAT) Law will come into effect, impacting millions of businesses and individuals, with VAT revenue projected to be approximately 6.57 trillion yuan in 2024, accounting for 38% of total tax revenue [3] - The revised National Common Language and Writing Law will promote the use of standard Chinese language and characters across various sectors, including public services and advertising [4] Group 2: Environmental and Technological Regulations - The National Park Law will prioritize hiring local residents for ecological protection roles and encourage public participation in conservation efforts [5] - The revised Cybersecurity Law will enhance monitoring and regulation of artificial intelligence risks, supporting the development of key technologies and ethical standards [6][7] - The new electric vehicle energy consumption standards will enforce stricter limits, improving energy efficiency and supporting the transition to low-energy vehicles [11] Group 3: Housing and Financial Regulations - The new policy on personal housing sales will impose a 3% VAT on properties sold within two years of purchase, while properties sold after two years will be exempt from VAT [12] - The People's Bank of China will implement a new digital currency framework, allowing interest to be paid on digital yuan wallet balances, marking a shift towards digital deposit currency [13][14] - The new financial regulations will eliminate the requirement for individuals to register cash withdrawals over 50,000 yuan, streamlining the process based on risk assessment [16]
这些新规,2026年1月1日起施行
Xin Hua She· 2025-12-31 02:16
Group 1: Social Security and Education - New regulations on social security, education, and public safety will take effect on January 1, 2026, addressing issues such as exam cheating and drone misuse [1] - The revised law on kindergarten fees mandates public and non-profit kindergartens to follow government-guided pricing, while for-profit kindergartens will have market-regulated fees [2] Group 2: Electric Vehicles - A mandatory standard for electric vehicle energy consumption will be implemented, requiring necessary technical upgrades for new products, with a target of not exceeding 15.1 kWh per 100 km for vehicles weighing around 2 tons, leading to an average range increase of approximately 7% [3] Group 3: Taxation - The new VAT law will come into effect, marking a significant step in establishing legal frameworks for taxation in China, with 14 out of 18 tax types now having legal statutes [4] Group 4: Language and Technology - The revised national language law will enhance the education and development of the national language, including regulations for online language use [5] - The new cybersecurity law will address artificial intelligence risks, promoting research and infrastructure development while enhancing risk monitoring and safety regulations [9] Group 5: Personal Credit - A one-time credit repair policy will be introduced, allowing for the automatic adjustment of overdue records based on specific repayment conditions, effective from January 1, 2026 [6] Group 6: Environmental Protection - The National Park Law will prioritize hiring local residents for ecological management positions and encourage public participation in environmental protection [7] Group 7: Civil Law - The revised civil case regulations will include disputes related to data and virtual property, expanding the total number of case types to 1,055 [10]