Core Viewpoint - The article discusses the launch of Matrix-Game, an interactive world modeling tool developed by Kunlun Wanwei, which allows users to create and explore virtual environments in a highly realistic manner using simple mouse and keyboard commands. This tool leverages AI to generate content in real-time, significantly lowering the barriers to entry for users and enhancing creative freedom while adhering to physical realism. Group 1: Matrix-Game Overview - Matrix-Game enables users to interact with and create detailed virtual content that aligns with real-world physics, offering a low operational threshold for users [10][41]. - The tool supports various environments, including forests, beaches, deserts, glaciers, rivers, and plains, and allows for basic and complex movements, perspective shifts, and actions like jumping and attacking [5][6][10]. - The Matrix-Game-MC dataset is a large-scale dataset that includes unlabelled Minecraft game videos and controllable video data, facilitating the model's learning of complex environmental dynamics and interaction patterns [14][15]. Group 2: Technical Implementation - The main model framework is based on diffusion models, which include image-to-world modeling, autoregressive video generation, and controllable interaction design [18][20]. - The image-to-world modeling process generates interactive video content from a single image, integrating user actions without relying on language prompts [21]. - The autoregressive video generation ensures temporal consistency by generating video segments based on previous frames, while controllable interaction design enhances the model's responsiveness to user inputs [23][27]. Group 3: Evaluation and Performance - The GameWorld Score evaluation system assesses the performance of interactive world generation models across four dimensions: visual quality, temporal quality, action controllability, and physical rule understanding [29][30]. - Matrix-Game outperforms existing models like Decart's Oasis and Microsoft's MineWorld in all evaluated dimensions, achieving a user preference rate of 96.3% in blind tests [36][39]. - In specific actions such as movement and attack, Matrix-Game maintains over 90% accuracy, demonstrating high precision in fine-grained control [39]. Group 4: Industry Implications - Matrix-Game has potential applications in rapidly building virtual game worlds, producing content for film and the metaverse, training embodied agents, and generating data [41][42]. - The trend towards 3D AI-generated content (AIGC) is gaining traction, with major companies investing in this area, indicating a shift from 2D to 3D technologies [43][46]. - The advancements in 3D AIGC and world modeling are expected to provide new interactive experiences, making it a focal point for future AI developments [48][49].
AI无限生成《我的世界》,玩家动动键盘鼠标自主控制!国产交互式世界模型来了