SIGGRAPH Asia 2025 | OmniPart框架，让3D内容创作像拼搭积木一样简单

Core Viewpoint - The article introduces OmniPart, a novel framework for part-aware 3D generation that addresses the challenge of creating, editing, and combining 3D object components, enhancing the quality and efficiency of 3D content creation [2][23]. Summary by Sections Introduction - Researchers from Hong Kong University, VAST, Harbin Institute of Technology, and Zhejiang University have developed OmniPart, which has been accepted for presentation at SIGGRAPH Asia 2025 [2]. Methodology - OmniPart employs a two-stage "planning-generation" strategy, decoupling complex generation tasks into controllable structure planning and spatially-conditioned part synthesis [8][10]. First Stage: Structure Planning - The first stage involves planning the 3D object's component layout using a self-regressive Transformer model that predicts bounding boxes based on 2D images. Users can control the decomposition granularity through flexible 2D part masks [10][11]. Second Stage: Part Generation - The second stage generates high-quality 3D parts based on the spatial blueprint created in the first stage. It utilizes a pre-trained 3D generator (TRELLIS) for efficient fine-tuning, ensuring high consistency among parts [12][13]. Experimental Results - OmniPart demonstrates superior generation quality compared to existing methods like Part123 and PartGen, excelling in geometric detail, semantic accuracy, and structural consistency [14][16]. - The efficiency of OmniPart is significantly improved, completing the end-to-end generation process in approximately 0.75 minutes, compared to 15 minutes for Part123 and 5 minutes for PartGen [16]. Applications - OmniPart supports various downstream applications, including mask-controlled generation, multi-granularity generation, material editing, and geometry processing, enhancing the editing and customization capabilities of 3D content [18][20][21]. Conclusion - The OmniPart framework sets a new benchmark in quality and efficiency for part-level 3D content generation, paving the way for advancements in game development, animation, and virtual reality [23].