在 3D 视觉领域， 如何从二维图像快速、精准地恢复三维世界 ，一直是计算机视觉与计 算 机 图 形 学 最 核 心 的 问 题 之 一 。 从 早 期 的 Structure-from-Motion (SfM) 到 Neural Radiance Fields (NeRF) ，再到 3D Gaussian Splatting (3DGS) ，技术的演进让我们 离实时、通用的 3D 理解越来越近。然而，以往的方法往往依赖于每个场景的反复优化 （per-scene optimization），既慢又缺乏泛化能力。在 AI 驱动的新时代，一个全新的范 式正在崛起 —— Feed-Forward 3D 。 点击下方 卡片 ，关注" 3D视觉之心 "公众号 第一时间获取 3D视觉干货 论文标题：Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Survey 论文链接：https://arxiv.org/abs/2507.14501 论文主页：https://fnzhan.com/projects/Feed-Forward-3D/ 这篇由 ...

Core Viewpoint - The article discusses the development and implementation of the Street Gaussians algorithm, which aims to efficiently model dynamic street scenes for autonomous driving simulations, addressing previous limitations in training and rendering speeds [2][3]. Group 1: Background and Challenges - Previous methods faced challenges such as slow training and rendering speeds, as well as inaccuracies in vehicle pose tracking [3]. - The Street Gaussians algorithm represents dynamic urban street scenes as a combination of point-based backgrounds and foreground objects, utilizing optimized vehicle tracking poses [3][4]. Group 2: Technical Implementation - The background model is represented as a set of points in world coordinates, each assigned a 3D Gaussian to depict geometric shape and color, with parameters including covariance matrices and position vectors [8]. - The object model for moving vehicles includes a set of optimizable tracking poses and point clouds, with similar Gaussian attributes to the background model but defined in local coordinates [11]. Group 3: Innovations in Appearance Modeling - The article introduces a 4D spherical harmonic model to encode temporal information into the appearance of moving vehicles, reducing storage costs compared to traditional methods [12]. - The effectiveness of the 4D spherical harmonic model is demonstrated, showing significant improvements in rendering results and reducing artifacts [16]. Group 4: Initialization Techniques - Street Gaussians utilizes aggregated LiDAR point clouds for initialization, addressing the limitations of traditional SfM point clouds in urban environments [17]. Group 5: Course and Learning Opportunities - The article promotes a specialized course on 3D Gaussian Splatting (3DGS), covering various subfields and practical applications in autonomous driving, aimed at enhancing understanding and implementation skills [26][30].

Group 1 - The core idea of the article revolves around Fei-Fei Li's new company, World Labs, which aims to develop the next generation of AI systems with "spatial intelligence" and world modeling capabilities [2][5][96] - World Labs has raised approximately $230 million in two funding rounds within three months, achieving a valuation of over $1 billion, thus becoming a new unicorn in the AI sector [3][4] - The company has attracted significant investment from major players in the tech and venture capital sectors, including a16z, Radical Ventures, NEA, Nvidia NVentures, AMD Ventures, and Intel Capital [4][5] Group 2 - Fei-Fei Li emphasizes that AI is transitioning from language models to world modeling, indicating a shift towards a more advanced stage of AI that can truly "see," "understand," and "reconstruct" the three-dimensional world [6][9][23] - The concept of a "world model" is described as AI's ability to understand the three-dimensional structure of reality, integrating visual, spatial, and motion information to simulate a near-real world [15][18][22] - Li argues that language models, while important, are limited as they compress information and fail to capture the full complexity of the real world, highlighting the necessity of spatial modeling for achieving true intelligence [14][23] Group 3 - Key technologies being explored for building world models include the ability to reconstruct three-dimensional environments from two-dimensional images, utilizing techniques like Neural Radiance Fields (NeRF) and Gaussian Splatting [28][32][48] - The article discusses the importance of multi-view data fusion, where AI must observe objects from various angles to form a complete understanding of their shape, position, and movement [40][41] - Li mentions that to enable AI to predict changes in the world, it must incorporate physical simulation and dynamic modeling, which presents significant challenges [45][46][48] Group 4 - The applications of world modeling technology are already being realized across various industries, such as gaming, architecture, robotics, and digital twins, where AI can generate realistic three-dimensional environments from minimal input [50][51][56] - Li highlights the potential of AI in the creative industries, where it can assist artists and designers by enhancing their spatial understanding and imagination [58][60] - The article notes that while the direction of world modeling is promising, challenges remain, including data availability, computational power, and the need for AI to generalize across different environments [61][66][67] Group 5 - Li emphasizes the importance of a multidisciplinary team at World Labs, combining expertise from various fields to tackle the complex challenges of developing world models [72][74] - The article discusses the evolving nature of AI research, moving from individual contributions to collaborative efforts that integrate diverse perspectives [77][78] - Li also addresses the societal implications of AI, advocating for a broader understanding of its impact on education, law, and ethics, emphasizing the need for responsible AI development [81][85][86] Group 6 - Li envisions a future where AI not only sees and reconstructs the world but also participates in it, serving as an intelligent extension of human capabilities [89][90][92] - The article suggests that the development of world models is a foundational step towards achieving Artificial General Intelligence (AGI), which requires spatial perception, dynamic reasoning, and interactive capabilities [94][96] - The potential for AI to transform various sectors, including healthcare and education, is highlighted, indicating a significant shift in how technology can enhance human understanding and interaction with the world [92][93][98]