Workflow
CoherentGS
icon
Search documents
打破恶性循环!CoherentGS:稀疏模糊图像也能高清重建
自动驾驶之心· 2025-12-20 02:16
Core Viewpoint - The article discusses the breakthrough technology CoherentGS developed by Peking University, which enables high-quality 3D scene reconstruction from a limited number of blurry images, addressing the challenges of sparse views and motion blur [5][33]. Group 1: CoherentGS Technology Overview - CoherentGS utilizes a "dual prior guidance" strategy, allowing the reconstruction of high-definition, coherent 3D scenes from just 3 to 9 blurry images [5][7]. - The system effectively addresses both "deblurring" and "geometric completion" issues through a collaborative optimization process [7][12]. - The core framework integrates deblurring and geometric completion into the entire 3D Gaussian optimization process, ensuring clear and coherent reconstruction results [10][12]. Group 2: Key Technologies of CoherentGS - The deblurring prior restores clear details and provides photometric guidance, essential for extracting reliable details from blurry images [13]. - The diffusion prior completes geometric gaps, ensuring global coherence by filling in unobserved areas with structured images [18]. - Consistency-guided camera exploration intelligently selects valuable viewpoints, enhancing optimization efficiency without blindly increasing perspectives [19][21]. - Joint optimization incorporates geometric regularization to avoid distortion, ensuring the reliability of reconstructed geometry [24][26]. Group 3: Performance Validation - CoherentGS outperforms existing methods, achieving a PSNR improvement of up to 2.78 dB and reducing LPIPS by over 40% on the Deblur-NeRF and DL3DV-BLUR datasets with 3 to 9 sparse blurry inputs [26]. - The qualitative results demonstrate that CoherentGS can recover texture details and maintain structural coherence, unlike other methods that produce either blurriness or fragmented structures [29]. - Frequency analysis shows that CoherentGS retains natural high-frequency details, confirming that the restored details are genuine and not artificially generated [32]. Group 4: Future Implications - CoherentGS represents a significant advancement in 3D reconstruction, breaking the dependency on dense, clear inputs, and has the potential to extend to various real-world scenarios involving defocus blur and exposure anomalies [33].