Acta Optica Sinica (Online), Volume. 2, Issue 17, 1711002(2025)

Infrared‒Visible Image Registration and Fusion Based on Dynamic Convolutional Dual Attention Network

Keyang Xia1, Shui Yu2, Qian Ni2, Qi Li2, Hongna Zhu1,2、*, and Bangji Wang1,2、**
Author Affiliations
  • 1School of Information Science and Technology, Southwest Jiaotong University, Chengdu 610031, Sichuan , China
  • 2School of Physical Science and Technology, Southwest Jiaotong University, Chengdu 610031, Sichuan , China
  • show less

    To address the requirement for efficient registration and fusion of unregistered infrared and visible images, we propose RRFNet-DCDAN, a unified infrared?visible image registration and fusion network incorporating a dynamic convolutional dual attention mechanism. This model enables adaptive fusion of unregistered multimodal images with different resolutions. RRFNet-DCDAN combines a dual attention network (DAN) and dynamic convolution attention (DCA) module. The DAN is employed to emphasize the salient features of infrared targets and preserve the texture details of visible images. Simultaneously, the DCA efficiently handles input image pairs with different resolutions. Based on the MSRS and RoadScene datasets, the proposed method outperforms other benchmark models (e.g., GTF and DenseFuse) in five evaluation metrics (e.g., mutual information and visual fidelity). Meanwhile, the image processing time is reduced by 20.57%. The proposed method provides a promising way for processing images with different resolutions.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Keyang Xia, Shui Yu, Qian Ni, Qi Li, Hongna Zhu, Bangji Wang. Infrared‒Visible Image Registration and Fusion Based on Dynamic Convolutional Dual Attention Network[J]. Acta Optica Sinica (Online), 2025, 2(17): 1711002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Computational Optics

    Received: Jul. 23, 2025

    Accepted: Jul. 31, 2025

    Published Online: Sep. 5, 2025

    The Author Email: Hongna Zhu (hnzhu@swjtu.edu.cn), Bangji Wang (bangjiw@163.com)

    DOI:10.3788/AOSOL250504

    CSTR:32394.14.AOSOL250504

    Topics