Workflow
用AI写代码效率反降19%!246项任务实测,16位资深程序员参与
量子位·2025-07-12 01:49

Core Insights - The use of AI tools in software development has been found to decrease productivity, with task completion times increasing by 19% when AI is utilized [16][14][22] - This outcome contradicts the common expectation that AI would enhance efficiency, as developers initially predicted a 24% improvement in their productivity [14][28] Group 1: Experiment Overview - A study involving 16 experienced developers was conducted, where they completed 246 tasks from well-known open-source repositories [6][10] - Tasks were randomly assigned to either allow or disallow the use of AI tools, specifically Cursor Pro with Claude 3.5/3.7 Sonnet [7][11] - Developers submitted their work for review upon completion, allowing for a comprehensive analysis of their performance under both conditions [13] Group 2: Findings on AI Usage - Developers completed 136 tasks with AI assistance and 110 tasks without it, yet the average time taken increased significantly when AI was involved [14][16] - The study revealed that in almost all time percentiles, tasks completed with AI took longer than those without [17][22] - Developers spent less time actively coding and searching for information when using AI, instead dedicating more time to reviewing AI outputs and waiting for AI responses [22] Group 3: Factors Affecting Productivity - The research identified 20 factors contributing to the observed slowdown, categorized into four groups: direct productivity loss, experimental bias, factors enhancing developer performance, and limitations of AI performance [22][25] - Five factors were found to have qualitative and quantitative evidence indicating they led to decreased efficiency, while nine factors showed mixed evidence regarding their impact [32][30] Group 4: Broader Implications - Despite AI potentially saving time, companies are not reducing workloads; instead, they expect employees to generate more output with the time saved [36][38] - This trend raises concerns about the actual benefits of AI in the workplace, as employees may face increased pressure rather than relief [33][37]