Acta Optica Sinica, Volume. 43, Issue 24, 2401012(2023)

Method for Eliminating Visual Occlusion from Suspended Impurity in Underwater Structural State Observation

Yongbing Xu1,3, Yaqin Zhou2、*, Qian Ye2, Jiangcan Jia2, and Di Wang1,3
Author Affiliations
  • 1Shandong Survey and Design Institute of Water Conservancy Co., Ltd., Jinan 250013, Shandong , China
  • 2College of Information Science and Engineering, Hohai University, Changzhou 213022, Jiangsu , China
  • 3Key Laboratory of Jinan Digital Twins and Intelligent Water Conservancy, Shandong Survey and Design Institute of Water Conservancy Co., Ltd., Jinan 250013, Shandong , China
  • show less
    Figures & Tables(14)
    Analysis of video frames of underwater structure detection with visual occlusion from suspended impurities
    Flow chart of suspended impurity occlusion removal method
    Flow chart of background displacement compensation and adjacent frame alignment
    Flow chart of detection process of underwater suspended impurity area based on dynamic visual perception
    Flow chart of suspended impurity occlusion area inpainting guided by the hybrid model
    Comparison between the proposed method and three typical marine snow removal algorithms. (a) Original images; (b) Banerjee method; (c) Cyganek method; (d) Koziarsk method; (e) proposed method
    Detection and inpainting effect of real underwater suspended impurity occlusion video
    Comparison of details before and after occlusion removal of suspended impurity
    Comparison of image quality indicators before and after occlusion removal of real underwater videos. (a) Comparison of mean values for Brenner function indicators; (b) comparison of mean values for EOG function indicators; (c) comparison of mean values for Laplace function indicators; (d) comparison of mean values for Tenengrad function indicators
    Occlusion elimination results of video frame 1 for synthetic underwater suspended impurities. (a) Synthetic images; (b) original images; (c) ground truths; (d) detection masks; (e) hybrid model maps; (f) restored images; (g) difference maps
    Occlusion elimination results of video frame 2 for synthetic underwater suspended impurities (a) Synthetic images; (b) original images; (c) ground truths; (d) detection masks; (e) hybrid model maps; (f) restored images; (g) difference maps
    Comparison of image quality evaluation indexes before and after inpainting of synthetic underwater suspended impurity videos. (a) Comparison of PSNR means; (b) comparison of SSIM means; (c) comparison of FSIM means; (d) comparison of GMSD means
    • Table 1. Quantitative analysis of detection and inpainting results of suspended impurities obscured area

      View table

      Table 1. Quantitative analysis of detection and inpainting results of suspended impurities obscured area

      IndexVideo frame
      12345678
      Recall0.9180.8600.9120.9380.9620.9780.9620.854
      Precision0.1830.1690.2360.2860.2050.2020.1870.204
      Mean absolute error0.0340.0510.0250.0240.0410.0380.0270.041
      Mean restoration error0.2720.3310.2930.2450.5090.4660.4700.493
    • Table 2. Analysis of running time of the proposed method

      View table

      Table 2. Analysis of running time of the proposed method

      DatasetAverage running time /s
      Adjacent frame alignmentDetection of suspended impuritiesElimination of occlusionTotal time
      Real-world dataset7.1921.4261.1979.815
      Synthetic dataset6.9780.1380.9558.071
    Tools

    Get Citation

    Copy Citation Text

    Yongbing Xu, Yaqin Zhou, Qian Ye, Jiangcan Jia, Di Wang. Method for Eliminating Visual Occlusion from Suspended Impurity in Underwater Structural State Observation[J]. Acta Optica Sinica, 2023, 43(24): 2401012

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Atmospheric Optics and Oceanic Optics

    Received: Jun. 13, 2023

    Accepted: Jul. 25, 2023

    Published Online: Dec. 8, 2023

    The Author Email: Zhou Yaqin (hhu_zyq@163.com)

    DOI:10.3788/AOS231118

    Topics