GAPS: Generative Active Pseudo-view Selection for Sparse-View 3D Gaussian Splatting

📅 2026-09-20
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文针对稀疏视角下3D高斯点渲染产生的几何不一致问题,提出了一种利用预训练图像扩散模型生成伪视图并进行选择性优化的方法,以提高重建质量和可靠性。
📝 Abstract
Novel view synthesis from sparse observations is severely under-constrained. Although 3D Gaussian Splatting (3DGS) enables real-time rendering, it produces floaters, broken geometry, and washed-out backgrounds when trained with few views. We propose an alternating optimization framework that uses a pre-trained image diffusion model to generate geometrically consistent pseudo-views for additional 3DGS supervision. Generation is constrained by depth-conditioned ControlNet, IP-Adapter style transfer, LoRA scene adaptation, and img2img structural anchoring. We introduce Generative Active Pseudo-view Selection (GAPS) to balance reconstruction informativeness and generative reliability when choosing target views. Its annealing schedule shifts from conservative interpolation early in training to exploratory extrapolation later, gradually covering unobserved regions. A dual-criterion admission gate and uncertainty-weighted losses reject unreliable generations, while density-adaptive DropGaussian reduces overfitting in complex scenes. On LLFF with 3/6/9 views, our method improves average PSNR over vanilla 3DGS by 0.40/0.89/0.70 dB. On Mip-NeRF 360 with 12/24 views, the gains are 1.18/0.80 dB. SSIM improves and LPIPS decreases in every setting. Ablations show that active selection and density-adaptive regularization are both necessary; only the full method reduces LPIPS below the no-pseudo-view baseline on unbounded 360-degree scenes.
Problem

Research questions and friction points this paper is trying to address.

Sparse-View
3D Gaussian Splatting
Novel View Synthesis
Innovation

Methods, ideas, or system contributions that make the work stand out.

Generative Active Pseudo-view Selection
depth-conditioned ControlNet
density-adaptive DropGaussian
🔎 Similar Papers
No similar papers found.
H
Hongfei Zhu
Shanghai Jiao Tong University, 800 Dongchuan Road, Shanghai, 200240, Shanghai, China; Goertek Inc., No. 268 Dongfang Road, Hi-tech Industrial Development Zone, Weifang, 261031, Shandong, China
H
Haochen Deng
Fudan University, 220 Handan Road, Shanghai, 200433, Shanghai, China; Goertek Inc., No. 268 Dongfang Road, Hi-tech Industrial Development Zone, Weifang, 261031, Shandong, China
S
Sitao Zhang
Goertek Inc., No. 268 Dongfang Road, Hi-tech Industrial Development Zone, Weifang, 261031, Shandong, China
L
Ling Zhou
Goertek Inc., No. 268 Dongfang Road, Hi-tech Industrial Development Zone, Weifang, 261031, Shandong, China