Chinese Journal of Liquid Crystals and Displays, Volume. 40, Issue 8, 1189(2025)

Asymmetric medical image fusion model based on Restormer and dual attention mechanism

Weiwei KONG*, Zejiang LI, Leilei HE, and Yusheng DU
Author Affiliations
  • School of Computer Science and Technology, Xi'an University of Posts & Telecommunications, Xi'an 710121, China
  • show less
    Figures & Tables(18)
    Overall network architecture of the proposed mode
    Contrast charts of attention used
    Fusion results of different Restormer stack depths
    MRI_CT fusion results
    MRI_PET fusion results
    MRI_SPECT fusion results
    Local magnification of MRI_CT image
    Local magnification of MRI_PET image
    Local magnification of MRI_SPECT image
    • Table 1. Quantitative analysis of fusion results

      View table
      View in Article

      Table 1. Quantitative analysis of fusion results

      堆叠深度SDVIFMIAG
      M=60,P=3067.130.653.088.21
      M=50,P=3069.360.673.148.52
      M=50,P=3563.840.582.567.37
      M=40,P=3064.210.623.048.01
      M=30,P=3059.380.572.487.32
      M=50,P=5058.970.552.377.45
      M=50,P=4059.130.562.487.63
      M=50,P=2065.560.572.864.71
      M=22,P=1258.370.522.447.21
      M=30,P=2058.650.532.397.33
      M=6,P=666.520.632.737.68
      M=20,P=2067.540.572.817.67
    • Table 2. Quantitative analysis results of MRI_CT

      View table
      View in Article

      Table 2. Quantitative analysis results of MRI_CT

      算法SDSFVIFSCDMIAGQABF
      CDD78.9938.140.571.403.788.890.67
      EMMA79.5927.910.491.473.317.310.55
      U251.6721.980.370.693.016.200.45
      AGM89.7027.650.451.793.227.550.52
      Swin82.9935.480.581.493.427.810.62
      SD53.9230.780.360.672.946.190.43
      RFN51.6211.680.580.203.303.920.36
      Ours83.4839.280.621.564.119.460.66
    • Table 3. Quantitative analysis results of MRI_PET

      View table
      View in Article

      Table 3. Quantitative analysis results of MRI_PET

      算法SDSFVIFSCDMIAGQABF
      CDD80.2727.490.661.792.787.490.65
      EMMA75.2722.110.601.712.556.680.56
      U250.4519.480.441.032.385.670.46
      AGM79.0522.530.541.802.537.030.55
      Swin63.4228.730.691.472.797.970.72
      SD49.0415.920.390.862.453.910.28
      RFN53.6415.560.470.652.464.960.47
      Ours69.3632.520.671.533.148.520.70
    • Table 4. Quantitative analysis results of MRI_SPECT

      View table
      View in Article

      Table 4. Quantitative analysis results of MRI_SPECT

      算法SDSFVIFSCDMIAGQABF
      CDD57.5920.380.911.213.495.170.77
      EMMA64.2117.010.541.662.644.450.57
      U245.9215.850.480.742.524.070.54
      AGM68.7616.260.541.782.664.560.56
      Swin52.5220.020.780.583.015.130.76
      SD45.2612.790.450.832.582.720.29
      RFN61.7413.030.571.192.653.750.55
      Ours66.9223.490.861.433.675.840.76
    • Table 5. Ablation results of MRI_CT

      View table
      View in Article

      Table 5. Ablation results of MRI_CT

      实验SDSCDVIFMIAGQABF
      i73.831.290.522.535.940.57
      ii61.831.470.602.655.530.38
      iii64.031.540.592.734.920.64
      iv75.361.660.603.787.340.58
      Ours83.481.560.624.119.460.66
    • Table 6. Ablation results of MRI_PET

      View table
      View in Article

      Table 6. Ablation results of MRI_PET

      实验SDSCDVIFMIAGQABF
      i58.331.330.512.466.030.58
      ii51.161.040.532.445.160.37
      iii43.240.930.552.434.850.43
      iv54.421.210.572.496.270.60
      Ours69.361.530.673.148.520.70
    • Table 7. Ablation results of MRI_SPECT

      View table
      View in Article

      Table 7. Ablation results of MRI_SPECT

      实验SDSCDVIFMIAGQABF
      i61.271.490.582.604.420.64
      ii39.621.180.482.403.600.33
      iii48.041.220.492.514.270.42
      iv55.501.210.612.644.670.68
      Ours66.921.430.863.675.840.76
    • Table 8. Results of α1 taking different values

      View table
      View in Article

      Table 8. Results of α1 taking different values

      α1AGSFVIFMI
      19.4038.890.624.14
      109.4639.280.624.11
      509.3938.640.614.03
      1009.4238.900.613.84
      5009.4639.380.614.06
      1 0009.3438.700.613.93
    • Table 9. Results of α2 taking different values

      View table
      View in Article

      Table 9. Results of α2 taking different values

      α2AGSFVIFMI
      19.0537.750.593.82
      109.3838.670.624.02
      209.3639.060.614.01
      309.4538.830.624.00
      409.4639.280.624.11
      509.4038.760.624.02
      5009.4239.180.624.07
      1 0009.3738.710.624.11
    Tools

    Get Citation

    Copy Citation Text

    Weiwei KONG, Zejiang LI, Leilei HE, Yusheng DU. Asymmetric medical image fusion model based on Restormer and dual attention mechanism[J]. Chinese Journal of Liquid Crystals and Displays, 2025, 40(8): 1189

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Apr. 14, 2025

    Accepted: --

    Published Online: Sep. 25, 2025

    The Author Email: Weiwei KONG (kwwking@163.com)

    DOI:10.37188/CJLCD.2025-0087

    Topics