Journal of Atmospheric and Environmental Optics, Volume. 18, Issue 5, 469(2023)

Infrared and visible images fusion with spatial multiscale residual networks

ZHANG Yimen1 and LIN Weiguo2、*
Author Affiliations
  • 1Beijing System Design Institute of Electro Mechanic Engineering, Beijing 100005, China
  • 2College of Information Science and Technology, Beijing University of Chemical Technology, Beijing 100029, China
  • show less
    References(23)

    [1] J C Castillo, A Fernández-Caballero, J Serrano-Cuerda et al. Smart environment architecture for robust people detection by infrared and visible video fusion. Journal of Ambient Intelligence and Humanized Computing, 8, 223-237(2017).

    [2] Y Tian, W J Yang, J Wang. Image fusion using a multi-level image decomposition and fusion method. Applied Optics, 60, 7466-7479(2021).

    [3] J Y Ma, Y Ma, C Li. Infrared and visible image fusion methods and applications: A survey. Information Fusion, 45, 153-178(2019).

    [4] I Goodfellow, J Pouget-Abadie, M Mirza et al. Generative adversarial networks. Communications of the ACM, 63, 139-144(2020).

    [5] H Li, X J Wu. DenseFuse: A fusion approach to infrared and visible images. IEEE Transactions on Image Processing, 28, 2614-2623(2018).

    [6] G Huang, Z Liu, L Van Der Maaten et al. Densely connected convolutional networks, 2261-2269(2017).

    [7] H Li, X J Wu, T Durrani. NestFuse: An infrared and visible image fusion architecture based on nest connection and spatial/channel attention models. IEEE Transactions on Instrumentation and Measurement, 69, 9645-9656(2020).

    [8] Z W Zhou, M M Rahman Siddiquee, N Tajbakhsh et al. UNet++: A Nested U-Net Architecture for Medical Image Segmentation. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, 3-11(2018).

    [9] W B An, H M Wang. Infrared and visible image fusion with supervised convolutional neural network. Optik, 219, 165120(2020).

    [10] J Y Ma, W Yu, P Liang et al. FusionGAN: A generative adversarial network for infrared and visible image fusion. Information Fusion, 48, 11-26(2019).

    [11] D D Xu, Y C Wang, S Y Xu et al. Infrared and visible image fusion with a generative adversarial network and a residual network. Applied Sciences, 10, 554(2020).

    [12] K M He, X Y Zhang, S Q Ren et al. Deep residual learning for image recognition, 770-778(2016).

    [13] J Y Ma, H Xu, J J Jiang et al. DDcGAN: A dual-discriminator conditional generative adversarial network for multi-resolution image fusion. IEEE Transactions on Image Processing, 29, 4980-4995(2020).

    [14] O Ronneberger, P Fischer, T Brox. U-net: Convolutional Networks for Biomedical Image Segmentation. Lecture Notes in Computer Science, 234-241(2015).

    [15] T Y Lin, P Dollár, R Girshick et al. Feature pyramid networks for object detection, 936-944(2017).

    [16] P F Liu, H C Zhao, F D Cao. Blind deblurring of noisy and blurry images of multi-scale convolutional neural network. Infrared and Laser Engineering, 48, 300-308(2019).

    [17] J Hu, L Shen, G Sun. Squeeze-and-excitation networks, 7132-7141(2018).

    [18] S Woo, J Park, J Y Lee et al. CBAM: Convolutional Block Attention Module, 3-19(2018).

    [19] P F Liu, H C Zhao, P X Li. Hyperspectral images reconstruction using adversarial networks from single RGB image. Infrared and Laser Engineering, 49, 143-150(2020).

    [20] H Xu, J Y Ma, Z L Le et al. FusionDN: A unified densely connected network for image fusion. Proceedings of the AAAI Conference on Artificial Intelligence, 34, 12484-12491(2020).

    [21] Y Fu, X J Wu. A dual-branch network for infrared and visible image fusion, 10675-10680(2021).

    [22] X C Zhang, P Ye, G Xiao. VIFB: A visible and infrared image fusion benchmark, 104-105(2020).

    [23] S W Tian, S Z Lin, H W Lei et al. Multi-band image synchronous super-resolution and fusion method based on improved WGAN-GP. Acta Optica Sinica, 40, 2010001(2020).

    Tools

    Get Citation

    Copy Citation Text

    Yimen ZHANG, Weiguo LIN. Infrared and visible images fusion with spatial multiscale residual networks[J]. Journal of Atmospheric and Environmental Optics, 2023, 18(5): 469

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Feb. 17, 2022

    Accepted: --

    Published Online: Dec. 1, 2023

    The Author Email: LIN Weiguo (linwg@mail.buct.edu.can)

    DOI:10.3969/j.issn.1673-6141.2023.05.007

    Topics