NeurIPS 2025 Spotlight | PhysX-3D：面向真实物理世界的3D资产生成范式

Core Insights - The article presents PhysXNet, the first systematically annotated 3D dataset based on physical properties, addressing the gap between virtual 3D assets and real-world physics [6][9][27] - It introduces PhysXGen, a novel framework for generating 3D assets that incorporates physical attributes, enhancing the realism and applicability of 3D models in various fields [9][18][27] Dataset Overview - PhysXNet includes over 26,000 annotated 3D objects with detailed physical properties, while the extended version, PhysXNet-XL, contains over 6 million programmatically generated 3D objects [9][10][16] - The dataset covers five core dimensions: physical scale, materials, affordance, kinematic information, and textual descriptions, providing a comprehensive resource for 3D modeling [6][9][27] Annotation Process - A human-in-the-loop annotation framework was developed to efficiently collect and label physical information, ensuring high-quality data [11][13] - The annotation process involves two main stages: initial data collection and determination of kinematic parameters, utilizing advanced models like GPT-4o for accuracy [13][11] Generation Methodology - PhysXGen integrates physical attributes with geometric structure and appearance, achieving a dual optimization goal for generating realistic 3D assets [18][27] - The framework demonstrates significant improvements in generating physical properties compared to existing methods, with relative performance enhancements in various dimensions [23][24] Experimental Results - The evaluation of PhysXGen shows notable advancements in both geometric quality and physical property accuracy, outperforming baseline methods in multiple metrics [20][21][23] - The results indicate a 24% improvement in physical scale, 64% in materials, 28% in kinematic parameters, and 72% in affordance compared to traditional approaches [23][24] Conclusion - The article emphasizes the importance of bridging the gap between 3D assets and real-world physics, highlighting the potential impact of PhysXNet and PhysXGen on fields such as embedded AI, robotics, and 3D vision [27]