Software 1.0

Search documents
深度|Andrej Karpathy:LLM 是一种新型的OS,Software 3.0 时代你的编程语言就是英语
Z Potentials· 2025-06-27 03:31
Core Insights - The article discusses the evolution of software paradigms from Software 1.0 (traditional coding) to Software 2.0 (neural network weights) and now to Software 3.0 (prompts), emphasizing the significance of natural language as a programming language [3][8][11] - It highlights the emergence of Large Language Models (LLMs) as a new type of operating system (LLM OS), reshaping the computing ecosystem and enabling new forms of interaction with AI [5][8] - The article identifies the greatest opportunity in developing "partially autonomous" AI applications, which enhance human capabilities rather than aiming for full automation [10][11] Software Paradigms - Software 1.0 involves traditional coding with specific programming languages, while Software 2.0 utilizes neural networks where data sets are prepared to optimize parameters [3] - Software 3.0 introduces prompts as the programming language, allowing for a more accessible and intuitive way to interact with AI [3][8] LLM as an Operating System - LLMs are compared to a new operating system, where they act as the CPU, with their expanding context window serving as memory, and external tools functioning as peripherals [5][8] - The current state of LLMs is likened to the 1960s computing era, where they are primarily cloud-based and accessed through thin clients [6][8] Opportunities in AI Development - The article emphasizes the need to understand the "mental model" of LLMs, which exhibit human-like characteristics but also have limitations such as hallucinations and memory issues [7][10] - Successful AI applications should focus on creating a feedback loop where AI-generated content is quickly verified by humans, enhancing efficiency [10] Accessibility of Software Development - Software 3.0 lowers the barrier to entry for programming, allowing individuals without formal training to create software through natural language [11] - The future of software design must cater not only to humans but also to intelligent agents, necessitating new standards and tools for better interaction [11][12]