Mitigating Object Hallucination in Large Vision-Language Models via False Discovery Controlled Visual Data Splitting
This study addresses the issue of object hallucination in large vision-language models during decoding, which arises from visual uncertainty and lacks principled image-level false positive control in existing methods. To this end, it proposes CORAL, a framework that models visual uncertainty through an uncertainty-aware visual data splitting strategy. Notably, CORAL introduces a false discovery rate (FDR) control mechanism that computes mirror statistics via symmetrically perturbed inputs and establishes data-driven thresholds, enabling training-free hallucination mitigation. The proposed approach is compatible with various mainstream architectures and significantly outperforms state-of-the-art methods across multiple benchmarks. By effectively suppressing hallucinations while preserving genuine object detection capabilities, this work substantially enhances the reliability and robustness of model outputs.