TENCENT(HK:00700) 量子位·2025-08-29 00:54Core Viewpoint - Tencent's Hunyuan has officially open-sourced an end-to-end video sound effect generation model called HunyuanVideo-Foley, aimed at enhancing audio production for video content creators across various industries [1][6]. Group 1: Product Features - HunyuanVideo-Foley is designed for video content creators, including short video creators, filmmakers, advertising creatives, and game developers, providing professional-level audio dubbing capabilities [2][9]. - The model can generate audio that accurately matches visual dynamics and semantic context, achieving high-fidelity audio production [9][18]. - It addresses three key challenges in video-to-audio (V2A) generation: the scarcity of multimodal datasets, unbalanced semantic responses, and poor audio quality [8]. Group 2: Technical Highlights - The model demonstrates strong generalization capabilities, producing synchronized audio across various video scenes, including character interactions, animal activities, and natural landscapes [10][11]. - HunyuanVideo-Foley balances information from both video and text descriptions, generating rich composite sound effects that enhance immersion [14][16]. - The audio quality reaches professional standards, accurately reproducing dynamic changes in sound, such as engine sounds and tire friction [18][24]. Group 3: Performance Metrics - HunyuanVideo-Foley outperforms existing open-source solutions in multiple authoritative benchmarks, achieving new state-of-the-art (SOTA) levels in audio fidelity, visual semantic alignment, and temporal alignment [21][24]. - In subjective evaluations, the model scored over 4.1 out of 5 in audio quality, semantic alignment, and temporal alignment, indicating near-professional audio generation capabilities [24][31]. Group 4: Industry Applications - The model provides efficient solutions for various industries, including: - Short video creators can generate background sound effects that match the rhythm of their content [31]. - Film production teams can quickly create rich soundscapes, reducing costs and time in post-production [31]. - Advertising companies can customize sound effects to enhance brand recall and visual impact [31]. - Game developers can generate immersive environmental sounds and character action effects in real-time [31].