Workflow
“AI教母”李飞飞的全新世界模型问世!一张英伟达AI芯片就能生成无限3D世界

Core Insights - World Labs, co-founded by Fei-Fei Li, has launched a new real-time generative world model called RTFM (Real-Time Frame Model) which utilizes large-scale video data for efficient end-to-end training [3][4] - RTFM can generate new 2D images from one or more 2D inputs without relying on explicit 3D representations, marking a significant advancement in AI rendering capabilities [3][4] - The model can render persistent and 3D-consistent scenes in real-time using a single NVIDIA H100 GPU, enabling interactive experiences in both real and virtual environments [4][10] Company Overview - World Labs was founded in March 2023 by Fei-Fei Li and three other scholars, focusing on developing efficient, scalable, and persistent world models [8][10] - The company raised $230 million in September 2023, achieving a valuation of $1 billion within three months of its establishment [10] - The team consists of approximately 24 members, with a significant representation of Chinese individuals [10] Technology and Innovation - RTFM addresses scalability issues that have long plagued world models, enhancing spatial intelligence in machines, which allows for better navigation and decision-making in complex 3D environments [6][7] - The model's efficiency is highlighted by its ability to support interactive frame rate inference with a single H100 GPU, while its scalability allows for continuous optimization as data and computational power grow [8][10] - Future plans include developing a large model (LWM) that comprehensively understands three-dimensional, physical, and temporal concepts, with applications in AR and robotics [10][12] Research and Development - Fei-Fei Li is also spearheading the Behavior 1K challenge, aimed at standardizing tasks in embodied intelligence and robotics research, providing a platform for training and evaluation [11][12] - The Behavior 1K challenge includes 1,000 tasks focused on long-horizon tasks in everyday environments, promoting collaboration and comparison among researchers [12] - The integration of various AI technologies is seen as a transformative moment for society, emphasizing a human-centered approach in AI development [12][13]