Laser & Optoelectronics Progress, Volume. 58, Issue 16, 1610005(2021)

Research on Multi-Frame Sea Surface Image Super Resolution Algorithm Based on Deep Learning

Yushuang Zhang, Wenbo Han*, Danfei Huang**, Liying Zhao, and Aiqi Zhong
Author Affiliations
  • College of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun, Jilin 130022, China
  • show less
    Figures & Tables(13)
    Structural diagram of proposed network
    Schematic of light flow estimation
    Map of convolutional neural networks in pyramid hierarchy
    Optical flow estimation of multi-frame images. (a)(d)(g) First image; (b)(e)(h) second image; (c)(f)(i) optical flow estimation map
    Spatial transformation module
    Structural diagram of residual network
    High-resolution image sequence and its target frame image
    Simulated low-resolution image sequence and its target frame image
    Comparison of experimental results of ship images. (a) Original image; (b) Bicubic algorithm; (c) SRCNN algorithm; (d) VDSR algorithm; (e) VDR-DUF algorithm; (f) proposed algorithm
    Comparison of experimental results of beach images. (a) Original image; (b) Bicubic algorithm; (c) SRCNN algorithm; (d) VDSR algorithm; (e) VDR-DUF algorithm; (f) proposed algorithm
    Comparison of experimental results of cliff coast images. (a) Original image; (b) Bicubic algorithm; (c) SRCNN algorithm; (d) VDSR algorithm; (e) VDR-DUF algorithm; (f) proposed algorithm
    Comparison of experimental results of sea surfing images. (a) Original image; (b) Bicubic algorithm; (c) SRCNN algorithm; (d) VDSR algorithm; (e) VDR-DUF algorithm; (f) proposed algorithm
    • Table 1. Objective evaluation indexes of each algorithm

      View table

      Table 1. Objective evaluation indexes of each algorithm

      ImageBicubic algorithmSRCNN algorithmVDSR algorithm
      PSNR /dBSSIMPSNR /dBSSIMPSNR /dBSSIM
      Fig.828.630.9428.880.9529.680.74
      Fig.930.570.9232.000.9334.050.93
      Fig.1029.330.8330.180.8531.190.85
      Fig.1129.640.9530.730.9731.620.98
      ImageVSR-DUF algorithmProposed algorithm
      PSNR /dBSSIMPSNR /dBSSIM
      Fig.825.950.8930.040.96
      Fig.928.450.9033.770.95
      Fig.1024.320.8130.790.85
      Fig.1125.010.9532.780.98
    Tools

    Get Citation

    Copy Citation Text

    Yushuang Zhang, Wenbo Han, Danfei Huang, Liying Zhao, Aiqi Zhong. Research on Multi-Frame Sea Surface Image Super Resolution Algorithm Based on Deep Learning[J]. Laser & Optoelectronics Progress, 2021, 58(16): 1610005

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Nov. 6, 2020

    Accepted: Dec. 8, 2020

    Published Online: Aug. 19, 2021

    The Author Email: Han Wenbo (hanwenbo@cust.edu.cn), Huang Danfei (huangd_f@163.com)

    DOI:10.3788/LOP202158.1610005

    Topics