🤖 AI Summary
To address the challenges of instance segmentation in dense visual scenes—particularly those arising from occlusion, cluttered backgrounds, and scale variation—this paper proposes PerSense++, a training-free, end-to-end personalized instance segmentation framework. Methodologically, it introduces (1) density-map-guided candidate point generation coupled with adaptive spatial gating for refined proposal selection; (2) a feedback-optimized density map generation module to enhance localization accuracy; and (3) diversity-aware exemplar selection, hybrid candidate generation, and irrelevant mask rejection to improve occlusion robustness. Extensive evaluations demonstrate that PerSense++ significantly outperforms state-of-the-art methods across multiple benchmarks. Furthermore, the authors introduce PerSense-D—the first dedicated benchmark dataset for dense personalized segmentation—to foster research in this emerging direction.
📝 Abstract
Segmentation in dense visual scenes poses significant challenges due to occlusions, background clutter, and scale variations. To address this, we introduce PerSense, an end-to-end, training-free, and model-agnostic one-shot framework for Personalized instance Segmentation in dense images. PerSense employs a novel Instance Detection Module (IDM) that leverages density maps (DMs) to generate instance-level candidate point prompts, followed by a Point Prompt Selection Module (PPSM) that filters false positives via adaptive thresholding and spatial gating. A feedback mechanism further enhances segmentation by automatically selecting effective exemplars to improve DM quality. We additionally present PerSense++, an enhanced variant that incorporates three additional components to improve robustness in cluttered scenes: (i) a diversity-aware exemplar selection strategy that leverages feature and scale diversity for better DM generation; (ii) a hybrid IDM combining contour and peak-based prompt generation for improved instance separation within complex density patterns; and (iii) an Irrelevant Mask Rejection Module (IMRM) that discards spatially inconsistent masks using outlier analysis. Finally, to support this underexplored task, we introduce PerSense-D, a dedicated benchmark for personalized segmentation in dense images. Extensive experiments across multiple benchmarks demonstrate that PerSense++ outperforms existing methods in dense settings.