TripoSF

Search documents
3D版DeepSeek卷起开源月:两大基础模型率先SOTA!又是VAST
量子位· 2025-03-28 10:01
Core Viewpoint - VAST has launched new 3D generative models, TripoSG and TripoSF, which have set new state-of-the-art (SOTA) benchmarks in the open-source 3D generation field, showcasing significant advancements in quality, detail, and performance [6][8][12]. Group 1: Model Launch and Features - TripoSG is a foundational 3D generative model that has achieved a new SOTA in open-source 3D generation, emphasizing quality, detail, and fidelity [14][16]. - TripoSF, currently in its first phase of open-source release, has proven its capabilities by surpassing existing open-source and closed-source methods, also achieving a new SOTA [8][16]. - VAST plans to continue its open-source initiative for a month, releasing new projects weekly, including various advanced 3D models and techniques [10][66]. Group 2: Technical Innovations - TripoSG incorporates several key design innovations, including the application of a Rectified Flow-based Transformer architecture for 3D shape generation, which offers a more stable and efficient training process compared to traditional diffusion models [21][22]. - The model is the first in the 3D domain to utilize a Mixture of Experts (MoE) Transformer, enhancing feature fusion and allowing for efficient integration of global and local image features [23][24]. - VAST has developed a high-quality Variational Autoencoder (VAE) with innovative geometric supervision, utilizing Signed Distance Functions (SDFs) for improved precision in geometric representation [28][30]. Group 3: Performance Metrics - TripoSG has been evaluated using Normal-FID and other quantitative metrics, demonstrating superior performance in semantic consistency and the ability to accurately reflect the input image's semantic content [34][35]. - TripoSF has achieved approximately 82% reduction in Chamfer Distance and about 88% improvement in F-score across multiple benchmark tests, indicating its high-quality output [57]. Group 4: Future Developments - VAST's upcoming projects include a comprehensive suite of 3D generation technologies, with plans for models focused on 3D component completion and general 3D model binding generation [66][67]. - The final week of the open-source month will feature cutting-edge explorations in 3D generation, including geometric refinement models and interactive sketch-to-3D models [68][69]. Group 5: Industry Impact - VAST is recognized as a leading company in the 3D generative model space, actively contributing to the open-source community and pushing the boundaries of 3D content creation technology [80][87]. - The company aims to democratize 3D content creation, making it accessible to everyone by the end of 2025, aligning with the broader trend of advancing AIGC technologies [85][86].