Acta Photonica Sinica, Volume. 52, Issue 11, 1110003(2023)

Infrared and Visible Image Fusion Based on Dual Channel Residual Dense Network

Xin FENG, Jieming YANG*, Hongde ZHANG, and Guohang QIU
Author Affiliations
  • School of Mechanical Engineering,Key Laboratory of Manufacturing Equipment Mechanism Design and Controlof Chongqing,Chongqing Technology and Business University,Chongqing 400067,China
  • show less
    References(32)

    [1] Jiayi MA, Yong MA, Chang LI. Infrared and visible image fusion methods and applications: a survey. Information Fusion, 45, 153-178(2019).

    [2] HAO ZHANG, Han XU, Xin TIAN et al. Image fusion meets deep learning: a survey and perspective. Information Fusion, 76, 323-336(2021).

    [3] S DAS, Yunlong ZHANG. Color night vision for navigation and surveillance. Transportation Research Record, 1708, 40-46(2000).

    [4] Jiping SUN, Weiqiang FAN. Mine dual-band image fusion in MS-ADoG domain combined with ReNLU and VGG-16. Acta Photonica Sinica, 51, 0310002(2022).

    [5] Yanpeng CAO, Dayan GUAN, Weilin HUANG et al. Pedestrian detection with unsupervised multispectral feature learning using deep neural networks. Information Fusion, 46, 206-217(2019).

    [6] Yu LIU, Shuping LIU, Zengfu WANG. A general framework for image fusion based on multi-scale transform and sparse representation. Information Fusion, 24, 147-164(2015).

    [7] Jiayi MA, Chen CHEN, Chang LI et al. Infrared and visible image fusion via gradient transfer and total variation minimization. Information Fusion, 31, 100-109(2016).

    [8] Yu LIU, Xun CHEN, Peng HU et al. Multi-focus image fusion with a deep convolutional neural network. Information Fusion, 36, 191-207(2017).

    [9] Jiayi MA, Linfeng TANG, Meilong XU et al. STDFusionNet: an infrared and visible image fusion network based on salient target detection. IEEE Transactions on Instrumentation and Measurement, 70, 1-13(2021).

    [10] J MA, W YU, P LIANG et al. FusionGAN: A generative adversarial network for infrared and visible image fusion. Information Fusion, 48, 11-26(2019).

    [11] Jiayi MA, Han XU, Junjun JIANG et al. DDcGAN: a dual-discriminator conditional generative adversarial network for multi-resolution image fusion. IEEE Transactions on Image Processing, 29, 4980-4995(2020).

    [12] Jiayi MA, Hao ZHANG, Zhenfeng SHAO et al. GANMcC: a generative adversarial network with multiclassification constraints for infrared and visible image fusion. IEEE Transactions on Instrumentation and Measurement, 70, 1-14(2021).

    [13] Hui LI, Xiaojun WU. DenseFuse: a fusion approach to infrared and visible images. IEEE Transactions on Image Processing, 28, 2614-2623(2019).

    [14] Han XU, Xinya WANG, Jiayi MA. DRF: Disentangled representation for visible and infrared image fusion. IEEE Transactions on Instrumentation and Measurement, 70, 1-13(2021).

    [15] Hui LI, Xiaojun WU, J KITTLER. RFN-Nest: an end-to-end residual fusion network for infrared and visible images. Information Fusion, 73, 72-86(2021).

    [17] Kaiming HE, Xiangyu ZHANG, Shaoqing REN et al. Deep residual learning for image recognition, 770-778(2016).

    [18] G HUANG, Z LIU, L VAN DER MAATEN et al. Densely connected convolutional networks, 2261-2269(2017).

    [22] Zhou WANG, A C BOVIK, H R SHEIKH et al. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13, 600-612(2004).

    [23] Hui LI, Xiao Jun WU, T DURRANI. NestFuse: an infrared and visible image fusion architecture based on nest connection and spatial/channel attention models. IEEE Transactions on Instrumentation and Measurement, 69, 9645-9656(2020).

    [24] T Y LIN, M MAIRE, S BELONGIE et al. Microsoft COCO: common objects in context, 740-755(2014).

    [26] Kede MA, KAI Zeng, Wang ZHOU. Perceptual quality assessment for multi-exposure image fusion. IEEE Transactions on Image Processing, 24, 3345-3356(2015).

    [27] V ASLANTAS, E ENDES. A new image quality metric for image fusion: The sum of the correlations of differences. Aeu-international Journal of Electronics and Communications, 69, 1890-1896(2015).

    [28] H R SHEIKH, M F SABIR, A C BOVIK. A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Transactions on Image Processing, 15, 3440-3451(2006).

    [29] Yu ZHANG, Yu LIU, Peng SUN et al. IFCNN: a general image fusion framework based on convolutional neural network. Information Fusion, 54, 99-118(2020).

    [30] Hao ZHANG, Han XU, Xiao YANG et al. Rethinking the image fusion: a fast unified image fusion network based on proportional maintenance of gradient and intensity. Proceedings of the AAAI Conference on Artificial Intelligence, 34, 12797-12804(2020).

    [31] Han XU, Jiayi MA, Junjun JIANG et al. U2Fusion: a unified unsupervised image fusion network. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 502-518(2022).

    [32] Jiangrao YUN. In-fibre Bragg grating sensors. Measurement Science and Technology, 8, 355(1997).

    [33] Huihong QIU, Dali ZHANG, Pingfan YAN. Information measure for performance of image fusion. Electronics Letters, 38, 313-315(2002).

    Tools

    Get Citation

    Copy Citation Text

    Xin FENG, Jieming YANG, Hongde ZHANG, Guohang QIU. Infrared and Visible Image Fusion Based on Dual Channel Residual Dense Network[J]. Acta Photonica Sinica, 2023, 52(11): 1110003

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: May. 19, 2023

    Accepted: Jun. 13, 2023

    Published Online: Dec. 22, 2023

    The Author Email: YANG Jieming (2871600119@qq.com)

    DOI:10.3788/gzxb20235211.1110003

    Topics