Laser & Optoelectronics Progress, Volume. 61, Issue 20, 2011011(2024)
Luminance-Adaptive Infrared and Visible Image Fusion Based on Retinex Theory (Invited)
To address the problems of inadequate adaptability and poor visual quality in existing infrared and visible image fusion methods under varying luminance conditions, this paper proposes a fusion method based on Retinex theory. First, the dimension of visible light images is enhanced using an encoder, followed by the decomposition of these images into reflectance and illuminance feature maps, which is consistent with Retinex theory. Second, the reflectance feature is combined with the infrared image feature obtained via the encoder,which enhanced using a structure tensor representation. In addition, convolution kernels with varying sizes are employed to extract multiscale features, which enriches the image's hierarchical information. Finally, the decoder reduces the feature map's dimensionality, and a learnable gamma transform layer is introduced to improve the contrast of the fused image. The model's performance is validated using multiple evaluation metrics on the LLVIP public dataset. The experimental results demonstrate that the proposed method enables adaptive fusion of visible and infrared images under different luminance environments, achieving superior fusion results in terms of both visual perception and quantitative assessment.
Get Citation
Copy Citation Text
Yihang Cheng, Zhengyu Qiao, Yong Huang, Qun Hao. Luminance-Adaptive Infrared and Visible Image Fusion Based on Retinex Theory (Invited)[J]. Laser & Optoelectronics Progress, 2024, 61(20): 2011011
Category: Imaging Systems
Received: Jul. 4, 2024
Accepted: Aug. 27, 2024
Published Online: Nov. 1, 2024
The Author Email:
CSTR:32186.14.LOP241637