Acta Optica Sinica, Volume. 44, Issue 12, 1201006(2024)

Polarization Information Restoration of Underwater Images Based on Deep Neural Network

Hedong Liu1, Yilin Han2, Xiaobo Li2, Zhenzhou Cheng1, Tiegen Liu1, Jingsheng Zhai2, and Haofeng Hu1,2、*
Author Affiliations
  • 1School of Precision Instrument and Opto-Electronics Engineering, Tianjin University, Tianjin 300072, China
  • 2School of Marine Science and Technology, Tianjin University, Tianjin 300072, China
  • show less
    Figures & Tables(11)
    Channel attention based polarimetric dense network for underwater image polarization information restoration. (a) Schematic diagram of the network structure; (b) internal structure of the RDB; (c) structure of the CA block
    Structure of the content and style loss
    Experimental setup for underwater polarization image acquisition
    Demo of underwater polarization image datasets. (a) Pairs of original images captured by polarization camera; (b) polarization images of four angles after polarization down-sampling processing; (c) rearranged polarization images
    Results of restored intensity images and polarization informations of different network structures
    Comparison of image descattering and polarization information restoration effects by different methods
    Influence of the number of CA modules on the recovery of polarization information
    Influence of RDB parameters on network performance. (a) Number of blocks D; (b) number of convolutional layers C; (c) number of channels in each convolutional layer G
    Influence of loss function weights on restoration results. (a) Influence on restored light intensity image; (b) influence on recovered DoLP image; (c) influence on recovered AoP image
    • Table 1. Network structure parameters

      View table

      Table 1. Network structure parameters

      ModuleLayer/blockInput channelOutput channelKernel
      SFEU-Net33
      Conv3G0(3,3)
      ConvG0G(3,3)
      RDBConvG × CG(3,3)
      ReLU
      ConvG ×(C + 1)G(1,1)
      CAGFFCA-1 ConvG × DG0(1,1)
      CA-3 ConvG0G0(3,3)
      CA-3 ConvG03(3,3)
    • Table 2. Influence of different network structures on the descattering results

      View table

      Table 2. Influence of different network structures on the descattering results

      NetPolarizationU-NetCACSLPSNR /dBPSNR(AoP)/dBPSNR(DoLP)/dB
      Net-1P√P√P√P√22.3418.3620.70
      Net-2P√P√P√21.5516.2117.65
      Net-3P√P√P√23.1415.8617.20
      Net-4P√P√P√23.1715.3916.03
      Net-5P√P√P√21.7416.7317.99
    Tools

    Get Citation

    Copy Citation Text

    Hedong Liu, Yilin Han, Xiaobo Li, Zhenzhou Cheng, Tiegen Liu, Jingsheng Zhai, Haofeng Hu. Polarization Information Restoration of Underwater Images Based on Deep Neural Network[J]. Acta Optica Sinica, 2024, 44(12): 1201006

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Atmospheric Optics and Oceanic Optics

    Received: Aug. 4, 2023

    Accepted: Sep. 19, 2023

    Published Online: Jun. 12, 2024

    The Author Email: Hu Haofeng (haofeng_hu@tju.edu.cn)

    DOI:10.3788/AOS231366

    CSTR:32393.14.AOS231366

    Topics