Core Insights - The article discusses the significant presence of AI-generated content in the review process for ICLR 2026, highlighting a trend where a substantial portion of review comments are created by AI [2][11]. Group 1: AI Usage in Paper Reviews - A systematic analysis of 75,800 review comments revealed that 21% were fully generated by AI, while 4% were heavily edited by AI, 9% moderately edited, and 22% lightly edited, with only 43% being fully human-written [2][11]. - AI-generated reviews tend to be longer by 26% and score higher on average, with fully AI-generated reviews averaging a score of 4.43 compared to 4.13 for fully human-written reviews [11]. - The average confidence level for fully AI-generated reviews is slightly higher, indicating a tendency to provide more confident evaluations [12]. Group 2: Implications and Responses - The ICLR 2026 organizing committee acknowledged the issue of low-quality reviews generated by AI and is considering appropriate measures, including marking and reporting such reviews [18]. - Suggestions for handling AI-generated reviews include removing poor evaluations and designating the reviewers as having failed their responsibilities, which could lead to automatic rejection of their submissions [18]. - Pangram Labs' analysis indicates that 39% of submitted papers utilized AI in some capacity, with a correlation between higher AI usage and lower average scores [8].
离了大谱,21%的ICLR 2026审稿意见竟是AI生成的?官方回应来了
机器之心·2025-11-17 03:19