Laser & Optoelectronics Progress, Volume. 59, Issue 4, 0410010(2022)
Unsupervised Infrared Image and Visible Image Fusion Algorithm Based on Deep Learning
Convolutional neural network (CNN) is gradually applied to the field of image fusion because of its excellent performance. For the fusion task of infrared image and visible image, because there is no label data, unsupervised learning modeling is of great significance. To solve this problem, an unsupervised end-to-end depth fusion algorithm is proposed. The algorithm can directly predict the fused image containing significant information of the source image from the input infrared source image and visible light source image. The proposed algorithm constructs an auto-encoder network and uses real datasets for training. The loss function used in the network is the image structure similarity index measure (SSIM), which is widely used in image fusion tasks. Specifically, an improved non reference image evaluation index is designed to calculate the loss function, so as to achieve the purpose of unsupervised training of the network. In addition, the attention mechanism is introduced into the model to further improve the fusion results. The proposed algorithm is compared with many fusion algorithms, experimental results show that the fusion results of the proposed algorithm are very competitive in both subjective evaluation and objective index evaluation.
Get Citation
Copy Citation Text
Guoyang Chen, Xiaojun Wu, Tianyang Xu. Unsupervised Infrared Image and Visible Image Fusion Algorithm Based on Deep Learning[J]. Laser & Optoelectronics Progress, 2022, 59(4): 0410010
Category: Image Processing
Received: Feb. 26, 2021
Accepted: Mar. 31, 2021
Published Online: Jan. 25, 2022
The Author Email: Wu Xiaojun (wu_xiaojun@jiangnan.edu.cn)