bounding box postprocessing

Techniques for turning raw detector outputs into reliable localized bounding boxes by applying geometric refinements, filtering (e.g., IoU thresholds, NMS), box regression adjustments, and model-specific heuristics to reduce false positives and improve localization in cluttered, multi-object scenes.

boundingboxpostprocessing

12-Month Skill Trend

Momentum and market value over time
Trending
Score
+20 in 12 mo
96
12 mo agoNow
Career
Value
+$12K in 12 mo
$42K/year
12 mo agoNow

Recommended Survey Paper

Quick overview of the field
View more

Must-Read Papers

Most classic and influential ideas
View more

Existing IoU-based bounding box regression losses suffer from gradient vanishing in non-overlapping cases and rely on handcrafted geometric penalty terms, leading to suboptimal small-object optimization and anomalous box expansion. To address these issues, we propose InterpIoU, which replaces conventional geometric penalties with a differentiable interpolated-box IoU—resolving gradient discontinuity and misalignment at the source. We further introduce Dynamic InterpIoU, which adaptively adjusts the interpolation coefficient based on object scale and spatial distribution. Our method requires no additional hyperparameters and is plug-and-play compatible with mainstream detectors. Extensive experiments on COCO, VisDrone, and PASCAL VOC demonstrate consistent superiority over state-of-the-art IoU-based losses: notably, small-object AP improves by +2.1–3.4 points, validating both effectiveness and generalizability across diverse detection scenarios.

Addresses non-differentiability and misalignment in IoU-based lossesEnhances small object detection with dynamic interpolationImproves bounding box regression for object detection

Confidence-driven Bounding Box Localization for Small Object Detection

Mar 03, 2023
HS
Huixin Sun
🏛️ Beihang University

Small-object detection suffers from significant performance degradation due to inaccurate localization and unstable gradients. This paper identifies that conventional regression-based bounding box localization induces distorted gradients for small objects. To address this, we reformulate bounding box localization as a grid-based classification task—the first such approach—and propose a confidence-driven localization framework. Our method employs two-hot label encoding, confidence distribution prediction, cross-entropy localization loss, and an entropy-based uncertainty loss to jointly correct gradient flow and suppress localization uncertainty. Evaluated on mainstream detectors—including YOLOv8 and RT-DETR—and across three major benchmarks (COCO, VisDrone, and AI-TOD), our approach achieves state-of-the-art performance, notably improving AP for small objects. Moreover, it demonstrates strong generalization across diverse annotation protocols and high-resolution imagery.

Addresses gradient instability in small object localizationImproves small object detection performance gapProposes uncertainty-aware framework for stable gradients

Improved Convex Decomposition with Ensembling and Boolean Primitives

May 29, 2024
VV
Vaibhav Vavilala
🏛️ UIUC | Leibniz Universität Hannover

This paper addresses the challenging fitting problem in constructive solid geometry (CSG) modeling for scene geometric parsing—characterized by unknown numbers of primitives, strong coupling between positive and negative primitives, and highly non-convex optimization. We propose a multi-regression ensemble framework integrating learned initialization, gradient-based geometric optimization, and Boolean composition modeling. Crucially, we introduce explicit representation of *negative convex primitives* to model voids and occlusions—a first in CSG-based reconstruction. Furthermore, we design a “refine-then-select” ensemble strategy that breaks from conventional paradigms. On standard benchmarks, our method significantly reduces depth and surface normal prediction errors; over 70% of images benefit from negative primitive modeling. The ensemble strategy substantially outperforms baselines, empirically confirming the problem’s severe non-convexity and validating the effectiveness of our approach.

Enhancing CSG representations with negative primitives for better geometry encodingImproving scene decomposition using geometric primitives and ensemblingOptimizing primitive count and interaction for accurate depth and segmentation

Verification for Object Detection - IBP IoU

Jan 30, 2024
NC
Noémie Cohen
🏛️ Airbus | ONERA

This work addresses the challenge of formally verifying the robustness of object detection models against input perturbations. We propose the first abstract interpretation framework specifically designed for IoU-based robustness certification, extending Interval Bound Propagation (IBP) to rigorously reason about IoU—a non-differentiable, geometric metric—under input uncertainty. Our method precisely models the interval propagation of bounding box coordinates through the IoU computation graph, enabling tighter and more stable bounds than existing IBP-based baselines. Experiments on runway detection and handwritten digit recognition demonstrate both empirical effectiveness and strong generalization across diverse detection tasks. The framework is implemented as open-source code, fully compatible with mainstream abstract interpretation verification toolkits.

Enhancing security in landing runway and digit detectionFormally verifying object detection models' robustness to perturbationsImproving accuracy and stability of Intersection over Union metric

Existing interpretability methods for object detection predominantly rely on single-pixel attribution, failing to capture the joint influence of multi-pixel collaborations on both bounding box localization and class prediction—thus overlooking compositional cues or introducing spurious correlations. To address this, we introduce Shapley interaction values to object detection interpretation for the first time, proposing the first end-to-end differentiable framework that explicitly models high-order cooperative effects among pixel groups. Our approach jointly models feature-space perturbations and detection output sensitivity to simultaneously quantify individual pixel contributions and higher-order interactions. Extensive experiments on COCO and other benchmarks demonstrate that our method significantly outperforms state-of-the-art interpretability baselines. Both qualitative visualizations and quantitative metrics confirm its superior ability to localize discriminative visual regions accurately. The source code will be made publicly available.

Captures both individual and collective pixel influencesExplains object detectors via collective pixel contributionsProvides explanations for bounding box and class decisions

Latest Papers

What's happening recently
View more

This work addresses the limitation of existing IoU-based loss functions, which employ fixed geometric penalty terms and thus struggle to adapt to the dynamic optimization requirements of bounding box regression across different training stages. To overcome this, the authors propose MoEIoU, the first IoU loss grounded in a Mixture-of-Experts (MoE) mechanism, formulating regression as a mixture-of-experts problem. MoEIoU leverages the log-sum-exp function to smoothly and adaptively aggregate errors in overlap, center alignment, and aspect ratio, while integrating a curriculum learning strategy to dynamically adjust the weights of these error components during training. Extensive experiments on PASCAL VOC, HRIPCB, and MS COCO demonstrate that MoEIoU consistently outperforms current state-of-the-art losses, yielding faster convergence, improved localization accuracy, and notable performance gains across multiple YOLO architectures.

bounding-box regressiongeometric penaltiesIoU-based loss

This work addresses the limitations of existing oriented bounding box regression methods, which rely solely on geometric information while neglecting semantic cues and suffer from unstable gradients during orientation optimization, leading to convergence oscillations. To overcome these issues, the authors propose Fractional-order Semantic IoU loss (FrSIoU), which, for the first time, integrates semantic similarity into IoU-based optimization. By leveraging fractional-order calculus to accumulate historical IoU states, FrSIoU establishes an adaptive gradient gating mechanism that unifies semantic and geometric modeling. Extensive experiments demonstrate consistent performance gains across diverse bounding box representations and visual detection tasks, effectively mitigating gradient oscillations and validating the method’s efficacy and generalization capability.

box regressiongradient instabilityIoU-based loss

Existing image manipulation localization methods rely primarily on 2D cues and suffer significant performance degradation when tampered regions are seamlessly blended with the background. This work proposes a geometry-aware localization framework that, for the first time, incorporates 3D geometric cues—such as depth and surface normals derived from monocular reconstruction—into the task. By assessing the reliability of these 3D cues, the method employs a multi-scale fusion mechanism to selectively integrate them with RGB features. The proposed approach achieves notably improved localization accuracy with minimal additional computational overhead, demonstrating that trustworthy 3D geometric information effectively complements conventional 2D forensic cues.

2D forensic cues3D geometryappearance-consistent manipulation

This work addresses the challenge of monocular 3D object detection in real-world scenarios where camera intrinsics are unknown, making accurate recovery of 3D geometry from the image plane difficult. To this end, we propose MoCA3D, a category-agnostic monocular 3D detection model that eliminates the need for camera intrinsics at inference time by directly predicting 3D bounding box corners and their depths densely in the image plane via corner heatmaps and depth maps. Departing from conventional paradigms that lift 2D RoIs to 3D boxes, our method introduces pixel-aligned geometric constraints, enabling high-fidelity, intrinsic-agnostic 3D geometry prediction for the first time. We further propose the PAG metric to evaluate consistency between predicted corners and depths, achieving a 22.8% improvement on this metric while matching state-of-the-art 3D IoU performance, with model parameters reduced by up to 57×, significantly enhancing applicability in settings lacking camera calibration.

3D bounding boxcamera intrinsicsimage-plane geometry

This work addresses the challenge of robustly lifting 2D object detections to metric 3D bounding boxes in open-world scenarios where dense depth maps and 3D annotations are scarce. To this end, we propose BoxerNet, a Transformer-based architecture that integrates open-vocabulary 2D detectors (e.g., OWLv2, DETiC), multi-view geometric constraints, and optional depth cues—either sparse or dense. A median-depth block enables effective handling of sparse depth inputs, while aleatoric uncertainty modeling enhances regression robustness. By combining geometric filtering with multi-view fusion, BoxerNet produces globally consistent, de-duplicated 3D boxes. Trained on over 1.2 million unique 3D bounding boxes, our model significantly reduces reliance on costly 3D annotations, achieving an mAP of 0.532 in ego-centric settings without dense depth—substantially outperforming CuTR (0.010)—and 0.412 on CA-1M, surpassing CuTR’s 0.250.

2D-to-3D lifting3D object localizationbounding box

Hot Scholars

M

Mausam

Professor of Computer Science & Engineering, Indian Institute of Technology Delhi
Artificial IntelligenceNeuro-Symbolic AIInformation ExtractionKnowledge Graph
LH

Le Hui

Northwestern Polytechnical University
point cloud
KM

Kira Maag

Heinrich-Heine-University Düsseldorf
Computer VisionDeep Learning
HG

Hanno Gottschalk

Professor for Mathematical Modeling of Industrial Life Cycles, TU Berlin
Applied MathematicsComputer VisionMachine LearningMathematical Physics
YA

Yoshimitsu Aoki

慶應義塾大学
コンピュータビジョン,パターン認識