Workflow
美团首个视频大模型开源,速度暴涨900%
3 6 Ke·2025-10-27 09:13

Core Insights - Meituan has launched its first video generation model, LongCat-Video, designed for multi-task video generation, supporting text-to-video, image-to-video, and video continuation capabilities [1][2] - LongCat-Video addresses the challenge of generating long videos, natively supporting outputs of up to 5 minutes, while maintaining high temporal consistency and visual stability [1] - The model significantly enhances inference efficiency, achieving a speed increase of over 900% by employing a two-stage generation strategy and block sparse attention mechanisms [1][10][13] Model Features - LongCat-Video utilizes a unified task framework that allows it to handle three types of video generation tasks within a single model, reducing complexity and enhancing performance [9][10] - The model architecture is based on a Diffusion Transformer structure, integrating diffusion model capabilities with long-sequence modeling advantages [7] - A three-stage training process is implemented, progressively learning from low to high-resolution video tasks, and incorporating reinforcement learning to optimize performance across diverse tasks [9][10] Performance Evaluation - In the VBench public benchmark test, LongCat-Video scored second overall, with a notable first place in "common sense understanding" at 70.94%, outperforming several closed-source models [2][20] - The model demonstrates strong performance in visual quality and motion fluidity, although there is room for improvement in text alignment and image consistency [19][20] - LongCat-Video's visual quality score is nearly on par with Google's Veo3, indicating competitive capabilities in the video generation landscape [17][20] Future Implications - Meituan views LongCat-Video as a foundational step towards developing "world models," which could enhance its capabilities in robotics and autonomous driving [22] - The model's ability to generate realistic video content may facilitate better modeling of physical knowledge and integration with large language models in future applications [22]