从 LLM 到 World Model：为什么我们需要能理解并操作世界的空间智能？

Core Insights - The article emphasizes the necessity of spatial intelligence and world models as the next key direction in AI development, moving beyond the limitations of language models (LLMs) [2][3] - It highlights the importance of understanding and interacting with the physical world through spatial reasoning, which is essential for achieving artificial general intelligence (AGI) [4][8] Group 1: Importance of Spatial Intelligence - Spatial intelligence is defined as the ability to reason, understand, move, and interact within three-dimensional space, complementing linguistic intelligence [4][5] - The evolution of human intelligence shows that visual and spatial capabilities have been optimized over 540 million years, while language has a much shorter history of about 500,000 years [7][8] - Ignoring the evolutionary significance of visual and spatial processing in favor of language-based models is deemed unreasonable for developing AGI [8][10] Group 2: World Labs and Marble - World Labs, founded by Fei-Fei Li and Justin Johnson in 2024, aims to create large world models that can perceive, generate, and interact with three-dimensional environments [15][16] - Marble is introduced as the first high-fidelity 3D world generation model, designed to push the development of spatial intelligence and provide practical value in industries like gaming and visual effects [17][20] - Marble allows for multimodal input and interactive editing, enabling users to generate and modify 3D scenes based on text or images, thus enhancing user control and experience [20][21] Group 3: Technical Innovations - The technology stack for Marble focuses on achieving a balance between high fidelity, real-time rendering efficiency, and physical realism [23][24] - Gaussian Splats are utilized as the fundamental unit for representing 3D worlds, allowing for rapid and high-quality scene reconstruction without traditional mesh models [24][25] - The challenge of ensuring physical realism in generated 3D scenes is addressed through the integration of traditional physics engines and the potential for assigning physical properties to Gaussian Splats [27][28] Group 4: Applications and Future Potential - Marble is positioned as a horizontal technology with applications across various industries, including creative fields, interior design, and robotics [31][34] - In robotics, Marble serves as a powerful simulator, generating synthetic data to train robots in complex environments, thus addressing the data scarcity issue [34][35] - The potential for Marble to become a foundational infrastructure for embodied intelligence is highlighted, suggesting its significance in the future of robotics [35]