Journals Articles Conferences News About CLP
Submit a paper Email Alert
Search
Search
Articles
Journals
News
Advanced Search
Top Searches
2D MaterialsTransformation opticsQuantum PhotonicsSmall lasersSemiconductor UV PhotonicsSupersymmetric microring laser arrays

Acta Optica Sinica (Online), Volume. 2, Issue 17, 1711002(2025)

Infrared‒Visible Image Registration and Fusion Based on Dynamic Convolutional Dual Attention Network

Keyang Xia1, Shui Yu2, Qian Ni2, Qi Li2, Hongna Zhu1,2、*, and Bangji Wang1,2、**
Author Affiliations
  • 1School of Information Science and Technology, Southwest Jiaotong University, Chengdu 610031, Sichuan , China
  • 2School of Physical Science and Technology, Southwest Jiaotong University, Chengdu 610031, Sichuan , China
    • show less
    AbstractGet PDF(in Chinese)
    Figures&Tables (12)
    Equations (0)
    References (32)
    Tools
    Paper Information
    Topics
    References(32)

    [1] Ma J Y, Ma Y, Li C. Infrared and visible image fusion methods and applications: a survey[J]. Information Fusion, 45, 153-178(2019).

    [2] Tang L F, Zhang H, Xu H et al. Deep learning-based image fusion: a survey[J]. Journal of Image and Graphics, 28, 3-36(2023).

    [3] Zhang X C, Demiris Y. Visible and infrared image fusion using deep learning[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45, 10535-10554(2023).

    [4] Wu Y F, Yang R, Lü Q S et al. Infrared and visible image fusion: statistical analysis, deep learning approaches and future prospects[J]. Laser & Optoelectronics Progress, 61, 1400004(2024).

    [5] Tang G L, Liu Z J, Xiong J. Distinctive image features from illumination and scale invariant keypoints[J]. Multimedia Tools and Applications, 78, 23415-23442(2019).

    [6] Li Q Q, Han G L, Liu P X et al. An infrared‒visible image registration method based on the constrained point feature[J]. Sensors, 21, 1188(2021).

    [7] Luo X Y, Wang S N, Yuan D. Weber-aware weighted mutual information evaluation for infrared‒visible image fusion[J]. Journal of Applied Remote Sensing, 10, 045004(2016).

    [8] Burt P J, Adelson E H. The Laplacian pyramid as a compact image code[J]. IEEE Transactions on Communications, 31, 532-540(1983).

    [9] Singh R, Khare A. Multiscale medical image fusion in wavelet domain[J]. The Scientific World Journal, 2013, 521034(2013).

    [10] Liu Y, Chen X, Ward R K et al. Image fusion with convolutional sparse representation[J]. IEEE Signal Processing Letters, 23, 1882-1886(2016).

    [11] Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks[J]. Communications of the ACM, 60, 84-90(2017).

    [12] Zhou Y. IYOLO-NL: an improved you only look once and none left object detector for real-time face mask detection[J]. Heliyon, 9, e19064(2023).

    [13] Shelhamer E, Long J, Darrell T. Fully convolutional networks for semantic segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 640-651(2016).

    [14] Zhao Z B, Zhao L L, Qi Y C et al. Infrared and visible image registration based on hypercolumns[M]. Computer vision, 773, 529-539(2017).

    [15] Kumari K, Krishnamurthi G. GAN-based end-to-end unsupervised image registration for RGB-infrared image[C], 62-66(2020).

    [16] Zhang X D, Zhang D W, Li Y Y et al. Mask-guided two-stage infrared and visible image fusion network[J]. Acta Optica Sinica, 45, 1510007(2025).

    [17] Xu H, Gong M Q, Tian X et al. CUFD: an encoder-decoder network for visible and infrared image fusion based on common and unique feature decomposition[J]. Computer Vision and Image Understanding, 218, 103407(2022).

    [18] Tang C Y, Pu S L, Ye P Z et al. Fusion of low-illuminance visible and near-infrared images based on convolutional neural networks[J]. Acta Optica Sinica, 40, 1610001(2020).

    [19] Tang L F, Yuan J T, Ma J Y. Image fusion in the loop of high-level vision tasks: a semantic-aware real-time infrared and visible image fusion network[J]. Information Fusion, 82, 28-42(2022).

    [20] Tang L F, Yuan J T, Zhang H et al. PIAFusion: a progressive infrared and visible image fusion network based on illumination aware[J]. Information Fusion, 83, 79-92(2022).

    [21] Fu Y, Wu X J, Durrani T. Image fusion based on generative adversarial network consistent with perception[J]. Information Fusion, 72, 110-125(2021).

    [22] Ma J Y, Zhang H, Shao Z F et al. GANMcC: a generative adversarial network with multiclassification constraints for infrared and visible image fusion[J]. IEEE Transactions on Instrumentation and Measurement, 70, 5005014(2020).

    [23] Xu H, Ma J Y, Le Z L et al. FusionDN: a unified densely connected network for image fusion[J]. Proceedings of the AAAI Conference on Artificial Intelligence, 34, 12484-12491(2020).

    [24] Fu J, Liu J, Tian H J et al. Dual attention network for scene segmentation[C], 3141-3149(2019).

    [25] Chen Y P, Dai X Y, Liu M C et al. Dynamic convolution: attention over convolution kernels[C], 11027-11036(2020).

    [26] Ma J Y, Chen C, Li C et al. Infrared and visible image fusion via gradient transfer and total variation minimization[J]. Information Fusion, 31, 100-109(2016).

    [27] Li H, Wu X J. DenseFuse: a fusion approach to infrared and visible images[J]. IEEE Transactions on Image Processing, 28, 2614-2623(2018).

    [28] Xu H, Ma J Y, Jiang J J et al. U2Fusion: a unified unsupervised image fusion network[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 502-518(2022).

    [29] Zhang Y, Liu Y, Sun P et al. IFCNN: a general image fusion framework based on convolutional neural network[J]. Information Fusion, 54, 99-118(2020).

    [30] Ni Q, Pan H A, Yu S et al. RRFNet: a unified network for multimodal image registration and fusion via RepVGG[J]. Applied Optics, 64, 5317-5324(2025).

    [31] Guo S, Wu K, Jeon S et al. IETAFusion: an illumination enhancement and target-aware infrared and visible image fusion network for security system of smart city[EB/OL]. https://www.authorea.com/users/673157/articles/672037-ietafusion-an-illumination-enhancement-and-target-aware-infrared-and-visible-image-fusion-network-for-security-system-of-smart-city?commit=1eda40ea5f6227c81fa3e1e5d3041eca3a2b41b3

    [32] Wang Z, Simoncelli E P, Bovik A C. Multiscale structural similarity for image quality assessment[C], 1398-1402(2003).

    Tools

    Get Citation

    Copy Citation Text

    Keyang Xia, Shui Yu, Qian Ni, Qi Li, Hongna Zhu, Bangji Wang. Infrared‒Visible Image Registration and Fusion Based on Dynamic Convolutional Dual Attention Network[J]. Acta Optica Sinica (Online), 2025, 2(17): 1711002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Set citation alerts for article
    Save article for my favorites
    Paper Information

    Category: Computational Optics

    Received: Jul. 23, 2025

    Accepted: Jul. 31, 2025

    Published Online: Sep. 5, 2025

    The Author Email: Hongna Zhu (hnzhu@swjtu.edu.cn), Bangji Wang (bangjiw@163.com)

    DOI:10.3788/AOSOL250504

    CSTR:32394.14.AOSOL250504

    Topics

    laser devices and laser physics
    Lasers and Laser Optics
    Laser physics
    laser manufacturing
    Instrumentation, Measurement and Metrology