Acta Photonica Sinica, Volume. 52, Issue 12, 1210004(2023)

Infrared and Visible Image Fusion Algorithm Based on Feature Optimization and GAN

Shuai HAO, Jiahao LI, Xu MA*, Tian HE, Siyan SUN, and Tong LI
Author Affiliations
  • College of Electrical and Control Engineering,Xi'an University of Science and Technology,Xi'an 710054,China
  • show less
    References(28)

    [1] Xingchen ZHANG, Y DEMIRIS. Visible and infrared image fusion using deep learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1, 1-20(2023).

    [2] Zhishe WANG, Wenyu SHAO, Fengbao YANG et al. Infrared and visible image fusion method via interactive attention-based generative adversarial network. Acta Photonica Sinica, 51, 0410002(2022).

    [3] Shuai HAO, Tian HE, Beiyi AN et al. VDFEFuse: a novel fusion approach to infrared and visible images. Infrared Physics & Technology, 121, 104048(2022).

    [4] Wanxin XIAO, Yafei ZHANG, Hongbin WANG et al. Heterogeneous knowledge distillation for simultaneous infrared-visible image fusion and super-resolution. IEEE Transactions on Instrumentation and Measurement, 71, 5004015(2022).

    [5] Zhengzheng TU, Zhun LI, Chenglong LI et al. Multi-interactive dual-decoder for RGB-thermal salient object detection. IEEE Transactions on Image Processing, 30, 5678-5691(2021).

    [6] Xingchen ZHANG, Ping YE, H LEUNG et al. Object fusion tracking based on visible and infrared images: a comprehensive review. Information Fusion, 63, 166-187(2020).

    [7] N NAGARANI, P VENKATAKRISHNAN, N BALAJI. Unmanned aerial vehicle's runway landing system with efficient target detection by using morphological fusion for military surveillance system. Computer Communications, 151, 463-472(2020).

    [8] Yuan GAO, Shiwei MA, Jingjing LIU et al. Fusion of medical images based on salient features extraction by PSO optimized fuzzy logic in NSST domain. Biomedical Signal Processing and Control, 69, 102852(2021).

    [9] Jun CHEN, Xuejiao LI, Linbo LUO et al. Infrared and visible image fusion based on target-enhanced multiscale transform decomposition. Information Sciences, 508, 64-78(2020).

    [10] Xiaoqi LU, Baohua ZHANG, Ying ZHAO et al. The infrared and visible image fusion algorithm based on target separation and sparse representation. Infrared Physics & Technology, 67, 397-407(2014).

    [11] Hui LI, Xiaojun WU. DenseFuse: a fusion approach to infrared and visible images. IEEE Transactions on Image Processing, 28, 2614-2623(2018).

    [12] Yu LIU, Xun CHEN, Juan CHENG et al. Infrared and visible image fusion with convolutional neural networks. International Journal of Wavelets, Multiresolution and Information Processing, 16, 1850018(2018).

    [13] Lihua JIAN, Xiaomin YANG, Zheng LIU et al. SEDRFuse: a symmetric encoder-decoder with residual block network for infrared and visible image fusion. IEEE Transactions on Instrumentation and Measurement, 70, 1-15(2020).

    [14] Jiayi MA, Wei YU, Pengwei LIANG et al. FusionGAN: a generative adversarial network for infrared and visible image fusion. Information Fusion, 48, 11-26(2019).

    [15] I GOODFELLOW, J POUGET-ABADIE, M MIRZA. Generative adversarial networks. Advances in Neural Information Processing Systems, 3, 2672-2680(2014).

    [16] Jiayi MA, Han XU, Junjun JIANG et al. DDcGAN: a dual-discriminator conditional generative adversarial network for multi-resolution image fusion. IEEE Transactions on Image Processing, 29, 4980-4995(2020).

    [17] M BRAIK. Chameleon swarm algorithm: a bioinspired optimizer for solving engineering design problems. Expert Systems with Applications, 174, 114685(2021).

    [18] Guangcan LIU, Zhouchen LIN, Yong YU. Robust subspace segmentation by low-rank representation, 663-670(2010).

    [19] Guangcan LIU, Shuicheng YAN. Latent low-rank representation for subspace segmentation and feature extraction, 1615-1622(2011).

    [20] Guangmang CUI, Huajun FENG, Zhihai XU et al. Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition. Optics Communications, 341, 199-209(2015).

    [21] Jiayi MA, Yong MA, Chang LI. Infrared and visible image fusion methods and applications: a survey. Information Fusion, 45, 153-178(2019).

    [22] Gao HUANG, Zhuang LIU, D VAN et al. Densely connected convolutional networks, 4700-4708(2017).

    [23] Zhishe WANG, Junyao WANG, Yuanyuan WU et al. UNFusion: a unified multi-scale densely connected network for infrared and visible image fusion. IEEE Transactions on Circuits and Systems for Video Technology, 32, 3360-3374(2021).

    [25] Hui LI, Xiaojun WU, T DURRANI. Infrared and visible image fusion with ResNet and zerophase component analysis. Infrared Physics & Technology, 102, 103039(2019).

    [26] Hui LI, Xiaojun WU, J KITTLER. MDLatLRR: a novel decompo-sition method for infrared and visible image fusion. IEEE Transactions on Image Processing, 29, 4733-4746(2020).

    [27] Hao ZHANG, Han XU, Yang XIAO et al. Rethinking the image fusion: a fast unified image fusion network based on proportional maintenance of gradient and intensity, 34, 12797-12804(2020).

    [28] Hui LI, Xiaojun WU, J KITTLER. RFN-Nest: an end-to-end residual fusion network for infrared and visible images. Information Fusion, 73, 72-86(2021).

    [29] Xiaoli ZHANG, Xiongfei LI, Jun LI. Validation and correlation analysis of metrics for evaluatiing performance of image fusion. Acta Automatica Sinica, 40, 306-315(2014).

    Tools

    Get Citation

    Copy Citation Text

    Shuai HAO, Jiahao LI, Xu MA, Tian HE, Siyan SUN, Tong LI. Infrared and Visible Image Fusion Algorithm Based on Feature Optimization and GAN[J]. Acta Photonica Sinica, 2023, 52(12): 1210004

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: May. 10, 2023

    Accepted: Jul. 24, 2023

    Published Online: Feb. 19, 2024

    The Author Email: MA Xu (maxu@xust.edu.cn)

    DOI:10.3788/gzxb20235212.1210004

    Topics