LeCun预言成真？这有一份通往AGI的硬核路线图：从BERT到Genie，在掩码范式的视角下一步步构建真正的世界模型

Core Viewpoint - The article discusses the emergence of World Models in AI, emphasizing the importance of Masking as a foundational principle for building these models, which are seen as essential for achieving Artificial General Intelligence (AGI) [1][3][5]. Group 1: Definition and Components of World Models - The true World Model is defined as an organic system composed of three core subsystems: a Generative Heart, an Interactive Loop, and a Memory System [6][8]. - The Generative Heart ($G$) predicts future states and simulates world dynamics, while the Interactive Loop ($F,C$) allows for real-time interaction and decision-making [8]. - The Memory System ($M$) ensures continuity over time, preventing the world from becoming a series of fragmented experiences [8][9]. Group 2: Evolution of World Models - The evolution of World Models is categorized into five stages, with Masking being the central theme throughout these stages [10][12]. - Stage I focuses on Mask-based Models, highlighting Masking as a universal generative principle rather than just a pre-training technique [13][24]. - Stage II aims for Unified Models that process and generate all modalities under a single architecture, with a debate between Language-Prior and Visual-Prior modeling approaches [25][26]. Group 3: Interactive Generative Models - Stage III introduces Interactive Generative Models, where models respond to user actions, transforming from mere simulators to interactive environments [36][40]. - The Genie series, particularly Genie-3, represents the state-of-the-art in real-time interactive models, achieving 720p resolution and 24fps frame rates [41][42]. Group 4: Memory and Consistency - Stage IV addresses Memory & Consistency, focusing on the need for persistent memory to prevent catastrophic forgetting and state drift in generated worlds [46][48]. - Solutions proposed include Externalized Memory, architecture-level persistence, and consistency governance to maintain coherence in generated environments [49][50]. Group 5: Ultimate Form of World Models - Stage V envisions True World Models that exhibit persistence, agency, and emergence, allowing for complex interactions and societal dynamics within the simulated world [51][52]. - The article concludes with the challenges of coherence, compression, and alignment that must be addressed to realize these advanced models [58].