Optics and Precision Engineering, Volume. 31, Issue 21, 3212(2023)

Underwater polarization image fusion based on unsupervised learning and attention mechanisms

Wenzhe GONG... Jinkui CHU, Haoyuan CHENG and Ran ZHANG* |Show fewer author(s)
Author Affiliations
  • Key Laboratory for Micro/Nano Technology and System of Liaoning Province, Dalian University of Technology, Dalian116024, China
  • show less
    Figures & Tables(9)
    Jaffe-McGlamery model
    Schematic diagram of polarization sensor
    Network architecture of under-water polarized image fusion algorithm
    Structure of attention unit
    Fusion result
    Comparison of fusion results of different methods for partial test set images
    • Table 1. Network structure configuration of under-water polarized image fusion algorithm

      View table
      View in Article

      Table 1. Network structure configuration of under-water polarized image fusion algorithm

      ModulesInputsLayersConvolution kernel sizeInput channelOutput channelActivation functionsOutputs
      Feature extractionS0Conv3×3116ReLU
      Conv3×31616ReLU

      Conv

      Conv

      3×3

      3×3

      32

      48

      16

      16

      ReLU

      ReLU

      AttentionBlock-64128ReLUFS0
      DoLPConv3×3116ReLU
      Conv3×31616ReLU
      Conv3×33216ReLU
      Conv3×34816ReLU
      AttentionBlock-64128ReLUFDoLP
      Feature fusionFS0,FDoLPConcat-128×2256-Ffused
      Image reconfigurationFfusedConv3×3256128ReLU
      Conv3×312864ReLU
      Conv3×36432ReLU
      Conv3×33216ReLU
      Conv3×3161-If
    • Table 2. Quantitative results of polarization image fusion by different methods

      View table
      View in Article

      Table 2. Quantitative results of polarization image fusion by different methods

      MethodENSDMISSIM
      CVT6.112 317.870.737 40.495 3
      GTF6.981 842.621.272 50.354 2
      MSVD6.059 117.110.757 40.495 9
      RP6.481 521.930.360 00.240 9
      Wavelet6.083 418.211.471 70.504 9
      Hidden Attention7.284 137.961.617 30.503 3
      Proposed method7.307 340.461.680 80.518 6
    • Table 3. Operating time of different methods

      View table
      View in Article

      Table 3. Operating time of different methods

      MethodOperating time/s
      CVT1.042 0
      GTF0.068 0
      MSVD0.356 8
      RP0.082 0
      Wavelet0.508 6
      Ours0.051 0
    Tools

    Get Citation

    Copy Citation Text

    Wenzhe GONG, Jinkui CHU, Haoyuan CHENG, Ran ZHANG. Underwater polarization image fusion based on unsupervised learning and attention mechanisms[J]. Optics and Precision Engineering, 2023, 31(21): 3212

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Feb. 23, 2023

    Accepted: --

    Published Online: Jan. 5, 2024

    The Author Email: ZHANG Ran (zhangr@dlut.edu.cn)

    DOI:10.37188/OPE.20233121.3212

    Topics