浙大&理想用全新连续性思路得到显著更好的深度估计效果

Core Viewpoint - The article discusses the InfiniDepth method, which utilizes a novel continuous approach to achieve significantly improved depth estimation with lower computational costs, particularly in predicting fine geometric details. Group 1: Depth Estimation Overview - Depth estimation is the process of inferring the three-dimensional structure of objects in a real image, where higher accuracy allows for better environmental perception and world model reconstruction [1]. - InfiniDepth provides high-precision geometric structures, offering relative depth from monocular RGB images and generating ultra-high-resolution absolute depth when combined with LiDAR or sparse depth inputs [1]. Group 2: Methodological Inspiration - InfiniDepth draws inspiration from advancements in 3D reconstruction, specifically NeRF and PiFU, which demonstrate that scenes can be modeled as continuous functions rather than rigid 3D pixels, achieving high geometric detail with fewer parameters [2]. - The LIIF (Learning Local Implicit Fourier Representation) method introduces implicit functions to 2D images, treating them as continuous signals for arbitrary scale super-resolution, which InfiniDepth applies to depth map predictions [3]. Group 3: Key Innovations - InfiniDepth challenges traditional depth estimation methods that restrict output resolution to the input image size, proposing a neural implicit field model for depth that decouples resolution from input size [4]. - The method consists of three core steps: - Feature extraction using a visual encoder (DINOv3) to create a feature pyramid that captures both macro and micro information [5]. - Depth decoding through a lightweight decoder (MLP) that efficiently translates features into depth values [6]. - Infinite depth querying that intelligently generates additional query points in sparse areas to ensure uniform distribution of 3D point clouds [7]. Group 4: Performance Metrics - InfiniDepth demonstrates superior depth map quality at higher resolutions, achieving better point cloud results and improved effects in bird's-eye view (BEV) perspectives [10][11][14]. - A new testing dataset was created based on five AAA games to address the limitations of traditional low-resolution and sparse ground truth depth maps, which often fail to capture fine geometric structures [15]. Group 5: Statistical Performance - InfiniDepth achieved first place in 58 out of 60 statistical metrics, with two second-place finishes, showcasing its effectiveness compared to other methods [16].