AI学术诚信问题

Search documents
真有论文这么干?多所全球顶尖大学论文,竟暗藏AI好评指令
机器之心· 2025-07-02 11:02
Core Viewpoint - A recent investigation reveals that at least 14 top universities have embedded secret instructions in research papers that only AI can read, aimed at manipulating AI reviews to improve scores [2][3]. Group 1: Academic Integrity Issues - The investigation found at least 17 papers from 8 countries containing hidden instructions, primarily in computer science, using techniques like white text on a white background to embed commands [3][10]. - This practice raises concerns about the integrity of academic peer review, as AI could give inflated evaluations based on these hidden instructions, undermining the objectivity of academic assessments [7][10]. - Some researchers view this as a form of "justifiable defense" against lazy reviewers who rely on AI for evaluations, while others acknowledge the unethical nature of such actions [8][7]. Group 2: Prompt Injection Attacks - The incident highlights a new type of cyber attack known as "prompt injection," where attackers use cleverly designed instructions to bypass AI safety and ethical constraints, potentially leading to the dissemination of biased or harmful content [10][13]. - This technique can extend beyond academic papers, such as embedding positive instructions in resumes to manipulate AI screening systems [10]. Group 3: Regulatory Challenges - There is a growing concern over the lack of unified rules regarding AI usage in academic evaluations, with some publishers allowing AI use while others prohibit it due to bias risks [18]. - The urgency to establish clear regulations for AI use across various sectors is emphasized, as governments and academic institutions face the challenge of leveraging AI benefits while ensuring effective oversight [18].