Karpathy 回应争议:RL 不是真的不行,Agent 还需要十年的预测其实很乐观
Founder Park·2025-10-20 12:45

Group 1 - The core viewpoint expressed by Andrej Karpathy is that the development of Artificial General Intelligence (AGI) is still a long way off, with a timeline of approximately ten years being considered optimistic in the current hype environment [10][21][23] - Karpathy acknowledges the significant progress made in Large Language Models (LLMs) but emphasizes that there is still a considerable amount of work required to create AI that can outperform humans in any job [11][12] - He critiques the current state of LLMs, suggesting they have cognitive flaws and are overly reliant on pre-training data, which may not be a sustainable learning method [13][14] Group 2 - Karpathy expresses skepticism about the effectiveness of reinforcement learning (RL), arguing that it has a poor signal-to-noise ratio and is often misapplied [15][16] - He proposes that future learning paradigms should focus on agentic interaction rather than solely relying on RL, indicating a shift towards more effective learning mechanisms [15][16] - The concept of a "cognitive core" is introduced, suggesting that LLMs should be simplified to enhance their generalization capabilities, moving away from excessive memory reliance [19] Group 3 - Karpathy critiques the current development of autonomous agents, advocating for a more collaborative approach where LLMs assist rather than operate independently [20][21] - He believes that the next decade will be crucial for the evolution of agents, with significant improvements expected in their capabilities [21][22] - The discussion highlights the need for realistic expectations regarding the abilities of agents, warning against overestimating their current capabilities [20][21] Group 4 - Karpathy emphasizes the importance of understanding the limitations of LLMs in coding tasks, noting that they often misinterpret the context and produce suboptimal code [47][48] - He points out that while LLMs can assist in certain coding scenarios, they struggle with unique or complex implementations that deviate from common patterns [48][49] - The conversation reveals a gap between the capabilities of LLMs and the expectations for their role in software development, indicating a need for further advancements [52]