Workflow
NeoVerse 4D世界模型
icon
Search documents
CreateAI联合中科院自动化所推出NeoVerse 4D世界模型
Core Insights - CreateAI has officially launched the NeoVerse 4D world model in collaboration with the Institute of Automation, Chinese Academy of Sciences, which is now available for global developers to review [2][5] - The NeoVerse model integrates diffusion and 4D Gaussian core technologies, trained on 1 million segments of open in-the-wild monocular video, enabling the construction of a general 4D world model in just 30 seconds [2][5] - The model addresses the scalability challenges faced by current 4D world model training solutions, breaking the reliance on expensive multi-view data and creating an infinite iterative loop of "reconstruction + generation" [2][5] Industry Applications - The 4D world model demonstrates significant application potential in digital content creation, game development, autonomous driving simulation, and embodied intelligence [2] - NeoVerse serves as a versatile 4D modeling solution that supports various applications such as 4D reconstruction, precise roaming, multi-view generation, video editing, and 3D point tracking, facilitating the transition of 4D technology from specialized to general use [2][5] - The model's ability to efficiently synthesize large amounts of 4D data from monocular video is expected to accelerate the adoption of 4D technology across multiple industries [5] Technical Advancements - NeoVerse supports powerful distillation LoRAs, allowing for rapid inference in under 30 seconds on a single graphics card, showcasing its strong industrial application potential [5] - The innovative approach of using Feedforward 4D Gaussian reconstruction combined with diffusion generation paves the way for the establishment of 4D world models without the need for costly multi-view data [5]
CreateAI联合中国科学院自动化所推出NeoVerse 4D世界模型
Zheng Quan Ri Bao Wang· 2026-01-05 12:10
Core Viewpoint - CreateAI has officially launched the NeoVerse 4D world model in collaboration with the Chinese Academy of Sciences, which integrates diffusion and 4DGS core technologies, enabling efficient 4D modeling without the need for expensive multi-view data [1][2] Group 1: Technology and Innovation - NeoVerse utilizes 1 million segments of open single-view videos for training, allowing the construction of a general 4D world model in just 30 seconds [1] - The model achieves a leading performance in standard benchmark tests, breaking the traditional reliance on costly multi-view data [1] - It supports various applications including 4D reconstruction, precise roaming, multi-view generation, video editing, and 3D point tracking, promoting the widespread adoption of 4D technology across industries [1] Group 2: Methodology - The model innovatively reconstructs Gaussian primitives to achieve "sparse frame reconstruction and dense frame rendering," ensuring temporal and spatial consistency in dynamic scenes [2] - NeoVerse can simulate degraded rendering modes from new perspectives using efficiently reconstructed Gaussian primitives, eliminating the need for expensive multi-view data [2] - The training pipeline requires only single-view videos, significantly lowering the technical application threshold [1][2] Group 3: Industry Impact - CreateAI's collaboration with the Chinese Academy of Sciences represents a significant achievement in addressing industry pain points through technology [2] - The scalable training of large models relies on vast amounts of data, with the new method paving the way for efficient synthesis of 4D data from single-view videos [2] - The company has previously achieved notable success in computer vision, with research papers selected for prestigious conferences, reinforcing its academic and technical leadership [2]