Workflow
AI论文评审智能体
icon
Search documents
学生3年投稿6次被拒,于是吴恩达亲手搓了个评审Agent
量子位· 2025-11-25 05:31
Core Insights - The article discusses the development of an AI paper review system created by Andrew Ng in response to a student's repeated rejections in academic submissions, aiming to expedite the review process and provide actionable feedback [2][24]. Group 1: AI Paper Review System - The AI review system was trained on ICLR 2025 review data, achieving a correlation coefficient of 0.42 with human reviewers, which is comparable to the 0.41 correlation among human reviewers [4][14]. - The system allows users to select the conference or journal for submission, tailoring the review process to the specific style of that venue [9]. - Upon submission, the system converts the PDF to Markdown, extracts keywords, and searches arXiv for relevant research to summarize and provide a complete review with specific modification suggestions [11][12]. Group 2: Performance and Accuracy - The AI system scores papers on a scale of 1-10 across seven dimensions, including originality and the importance of the research question, with a final score calculated by a model [13][14]. - While the AI's scoring correlates well with human scores, human reviewers have a higher accuracy rate of 0.84 in predicting acceptance compared to the AI's 0.75 [14]. - The AI review system reflects the likelihood of a paper's acceptance to some extent, although it primarily references content from arXiv, which may introduce some inaccuracies [20][21]. Group 3: User Experience - Users have expressed that receiving a quick rejection from the AI is preferable to waiting months for human feedback, allowing for faster revisions and resubmissions [6][7]. - The system is currently available for researchers to try, potentially increasing their chances of acceptance [29].