Multi-illuminant Color Constancy via Multi-scale Illuminant Estimation and Fusion

📅 2025-02-04
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
Existing color constancy methods suffer from localized chromatic distortions in multi-illuminant scenes due to single-scale illumination modeling. To address this, we propose a multi-scale illumination estimation and fusion framework. Our method employs a three-branch convolutional network to jointly extract features at multiple scales, models the illumination map as a linear combination of scale-specific illumination components, and introduces an attention-driven adaptive fusion module that dynamically weights each component for pixel-wise illumination prediction. This design enables precise, spatially varying illumination estimation tailored to complex lighting conditions. Evaluated on multiple benchmark datasets, our approach achieves state-of-the-art performance in color restoration accuracy—particularly in regions with heterogeneous illuminants—demonstrating the effectiveness of multi-scale modeling and attention-guided adaptive fusion for illumination estimation.

Technology Category

Computer Vision: Multi-modal VisionMachine Learning: Multimodal LearningIntelligent Robots: Multimodal Perception & Sensor Fusion

Application Category

Graph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphsSearch and Retrieval-Augmented AI: Efficiency and scalability of Web search enginesEconomics, Online Markets and Human Computation: Cost models of using LLMs in production systems
📝 Abstract
Multi-illuminant color constancy methods aim to eliminate local color casts within an image through pixel-wise illuminant estimation. Existing methods mainly employ deep learning to establish a direct mapping between an image and its illumination map, which neglects the impact of image scales. To alleviate this problem, we represent an illuminant map as the linear combination of components estimated from multi-scale images. Furthermore, we propose a tri-branch convolution networks to estimate multi-grained illuminant distribution maps from multi-scale images. These multi-grained illuminant maps are merged adaptively with an attentional illuminant fusion module. Through comprehensive experimental analysis and evaluation, the results demonstrate the effectiveness of our method, and it has achieved state-of-the-art performance.
Problem

Research questions and friction points this paper is trying to address.

Eliminate local color casts
Improve multi-scale illuminant estimation
Enhance illuminant map accuracy
Innovation

Methods, ideas, or system contributions that make the work stand out.

Multi-scale illuminant estimation
Tri-branch convolution networks
Attentional illuminant fusion module
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
H
Hang Luo
School of Computer Science and Artificial Intelligence, Wuhan Textile University, No.1 Sunshine Avenue, Jiangxia District, Wuhan, Hubei Province, China
R
Rongwei Li
School of Computer Science and Artificial Intelligence, Wuhan Textile University, No.1 Sunshine Avenue, Jiangxia District, Wuhan, Hubei Province, China
Jinxing Liang
Jinxing Liang
武汉大学
spectral imagingcultural heritage protection