Optics and Precision Engineering, Volume. 33, Issue 2, 282(2025)

Multiscale semantic injective fusion of nighttime infrared and visible

Yanchun YANG*, Jialong LI, Yi LI, and Zeyu WANG
Author Affiliations
  • School of Electronical and Information Engineering,Lanzhou Jiaotong University, Lanzhou730070, China
  • show less
    Figures & Tables(17)
    Relationship between low light and normal light images
    Lighten back-projection
    Lightening and darkening operators
    Overall network architecture diagram
    Low light enhancement module architecture
    Residuals and results for three LBP iterations
    Cross-attention mechanism
    Fusion network
    Blended attention mechanisms
    Results of nighttime infrared and visible light experiments
    20 sets of images with 6 metrics to analyze the graph
    Results of ablation experiments
    Target detection results
    • Table 1. Detailed design of low-light enhancement module

      View table
      View in Article

      Table 1. Detailed design of low-light enhancement module

      卷积核大小输出通道数
      浅层特征提取层Conv13×332
      Conv23×364
      残差迭代层卷积Conv13×364
      空洞Conv

      3×3

      (扩张率为2)

      64
      Conv23×3128
      重建层Conv11×1128
      Conv23×364
      Conv33×332
      Conv43×33
    • Table 2. Detailed design of the fusion module

      View table
      View in Article

      Table 2. Detailed design of the fusion module

      卷积核大小输出通道数
      Conv13×364
      Conv23×3128
      Conv31×1128
      Conv43×364
      Conv53×364
    • Table 3. Mean of fusion results of 20 groups

      View table
      View in Article

      Table 3. Mean of fusion results of 20 groups

      MethodENVIFMIQAB/FSCDSF
      TIF6.909 40.815 82.923 60.376 81.279 40.026 8
      BRG6.791 10.837 82.873 80.454 11.293 70.043 3
      MDLSR_RFM7.040 70.940 73.0490.642 41.212 40.044 2
      DenseFuse7.227 10.917 92.957 40.638 21.484 90.052 1
      FusionGAN6.717 10.778 72.866 20.388 61.214 40.039 5
      RFN-Nest6.813 80.877 52.300 40.604 01.272 60.035 8
      SDNet6.849 10.858 32.345 60.373 41.276 80.048 3
      U2Fusion6.821 40.791 93.114 30.395 81.214 30.029 1
      SDCFusion7.272 71.040 23.107 70.675 51.482 80.049 2
      Ours7.344 81.066 93.262 50.668 41.529 40.054 5
    • Table 4. Quantitative analysis of ablation experiments

      View table
      View in Article

      Table 4. Quantitative analysis of ablation experiments

      ModelPSNRSSIM
      GE59.249 40.774 1
      BAM+GE61.392 80.798 1
      BAM+GE+CAM62.005 40.819 2
      BAM+GE+SIM61.813 20.801 7
      BAM+GE+CAM+SIM62.419 70.820 2
      BAM+GE+CAM+SIM+LEM62.981 10.835 1
    Tools

    Get Citation

    Copy Citation Text

    Yanchun YANG, Jialong LI, Yi LI, Zeyu WANG. Multiscale semantic injective fusion of nighttime infrared and visible[J]. Optics and Precision Engineering, 2025, 33(2): 282

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: May. 21, 2024

    Accepted: --

    Published Online: Apr. 30, 2025

    The Author Email: Yanchun YANG (yangyanchun102@sina.com)

    DOI:10.37188/OPE.20253302.0282

    Topics