Workflow
多模态潜在空间规划技术
icon
Search documents
多人有声视频一体化生成!用百度最新AI生成营销视频,现在1.4元/5秒
量子位· 2025-08-21 11:10
Core Viewpoint - Baidu has shifted its stance on video generation models, now aggressively developing its MuseSteamer (蒸汽机) video generation model, which has recently upgraded to version 2.0, focusing on integrated multi-person audio and video generation [1][21]. Summary by Sections Product Features - MuseSteamer 2.0 excels in complex camera movements and storytelling capabilities, with improved video quality [2]. - The model can generate detailed visuals, including intricate features like scales and makeup on characters, and can create humorous scenarios [3]. - Users can experience the product through Baidu search or the "绘想" platform [5]. - There are four versions of MuseSteamer 2.0: Turbo, Lite, Pro, and Audio, with varying pixel quality and features [6]. - The pricing is competitive, with the Turbo audio version priced at 2.5 yuan per second, and a limited-time offer of 1.4 yuan for 5 seconds [8]. Technical Innovations - The model achieves integrated multi-person audio and video generation with millisecond precision in aligning voice with lip movements and expressions [17]. - It employs a unique Latent Multi-Modal Planner technology to coordinate multiple roles and emotions, ensuring coherent storytelling [17]. - The model is designed to deeply adapt to Chinese scenarios, achieving over 98% accuracy in rendering Chinese speech details and emotional expressions [18]. - It generates film-quality visuals through precise dynamic characterization of subjects [19]. - The camera control is sophisticated, utilizing professional lens techniques to align visual details with creative intent [20]. Market Strategy - Baidu's development of MuseSteamer is driven by the strong demand from its internal applications, including search, content distribution, and commercial needs [21][26]. - The model is already widely used within Baidu's mobile ecosystem, enhancing multi-modal experiences across various platforms [22]. - Examples of applications include creative marketing videos for brands like Volkswagen and Yili, showcasing the model's capabilities in real-world scenarios [24][25].