多模态生成式世界模型
Search documents
周末来造梦!李飞飞世界模型正式开放,能力升级,有免费版
机器之心· 2025-11-13 08:26
Core Insights - The article discusses the launch of Marble, a multi-modal generative world model developed by Fei-Fei Li's "Spatial Intelligence" team, which is now available for public use, allowing users to create 3D worlds easily [3][4]. Features and Capabilities - Marble has undergone significant upgrades since its preview release, now supporting more generation methods, deeper editing capabilities, and a wider range of output formats, making it suitable for various professional applications such as game development, film effects, architectural design, and robotic simulation [4]. - The platform offers both a free version and a membership version, with differences in the number of worlds that can be generated, the range and depth of editing features, and commercial licensing [6]. Multi-Modal Input - Marble's core upgrade is its heavy multi-modal capability, allowing users to input various types of information, including multiple images, to create more refined 3D worlds [7][12]. - Users can provide different reference images for various areas of the world, enabling a more cohesive 3D space [7]. Editing and Iteration - Marble allows for iterative creation, where users can modify the generated world post-creation, including object removal, local adjustments, and structural reconfigurations [12][20]. - The platform supports input from multiple real-world photos or short video clips to inspire virtual world creation, with seamless transitions between views [14]. Expansion and Detail Enhancement - Users can expand specific areas of the generated world to fill in missing details and enhance clarity, particularly in areas that may have been less defined during initial generation [23][24]. - The platform also allows for the combination of multiple worlds based on user-defined relationships, facilitating the construction of larger spaces [25]. Output and Rendering - Marble enables users to export created worlds in various formats, including high-fidelity Gaussian Splat representations and triangle meshes, ensuring compatibility with industry-standard tools [27][28]. - Users can render worlds as videos with pixel-level control over camera movements and pacing, enhancing the creative process [31]. Collaborative Exploration - The company has launched Marble Labs to collaborate with artists, designers, and engineers to explore new creative paradigms and best practices [36]. - Marble is positioned as a step towards "spatial intelligence," with future plans to enhance interactivity and expand applications in simulation and robotics [37].