Acta Photonica Sinica, Volume. 50, Issue 1, 188(2021)

Registration of Laser Point Cloud and Optical Image in Urban Area Based on Semantic Segmentation

Ying ZHU1 and Ming ZHAO1,2
Author Affiliations
  • 1College of Information Engineering, Shanghai Maritime University, Shanghai20306,China
  • 2Key Laboratory of Intelligent Infrared Perception, Chinese Academy of Sciences, Shanghai00083, China
  • show less
    Figures & Tables(19)
    Flow diagram
    Construction of Unet
    The segmentation results of UNET model for different kind image
    The outline of buildings(blue) and the minimum enclosing rectangle(red) from the segmentation result
    Find the pairs of matched points
    The depth image
    The first comparative experiment of optical image segmentation results between traditional segmentation method and deep learning method
    The second comparative experiment of optical image segmentation results between traditional segmentation method and deep learning method
    The first group of comparative experiments of point cloud segmentation results between traditional segmentation method and deep learning method
    The second group of comparative experiments of point cloud segmentation results between traditional segmentation method and deep learning method
    The first group of test data
    The second group of test data
    The third group of test data
    Point matching result
    Registration result
    Intermediate process diagram of the Method II
    • Table 1. Segmentation index data

      View table
      View in Article

      Table 1. Segmentation index data

      DataSegment methodSDRSFNRSACC
      The first optical imageUnet94.93%11.22%84.76%
      Meanshift clustering segmentation85.06%14.19%74.58%
      Maximum entropy threshold segmentation85.56%8.53%79.24%
      The second optical imageUnet99.65%11.82%87.91%
      Meanshift clustering segmentation78.71%34.17%55.88%
      Maximum entropy threshold segmentation80.46%6.08%76.48%
      The first point cloudUnet95.67%10.74%86.80%
      Meanshift clustering segmentation25.19%49.53%20.20%
      Maximum entropy threshold segmentation22.29%56.72%17.25%
      The second point cloudUnet99.60%14.62%85.08%
      Meanshift clustering segmentation20.28%3.91%20.11%
      Maximum entropy threshold segmentation22.29%56.72%17.25%
    • Table 2. Registration accuracy(uint:pixel)

      View table
      View in Article

      Table 2. Registration accuracy(uint:pixel)

      DataMin errorMax errorAverage error

      The first group

      of test data

      a1.414.472.85
      b2.235.383.05
      c2.235.833.51
      d1.003.612.14
      e1.003.002.27

      The second group

      of test data

      a2.236.064.05
      b4.475.004.73
      c2.003.602.88
      d1.074.242.76
      e1.415.653.51

      The third group

      of test data

      a1.244.002.71
      b2.002.822.47
      c2.005.093.27
      d2.236.083.98
      e1.004.002.39
    • Table 3. The matching of feature points of method II, method III and our method. And the root mean square error of four registration methods

      View table
      View in Article

      Table 3. The matching of feature points of method II, method III and our method. And the root mean square error of four registration methods

      DataMethod IMethod IIMethod IIIOur method
      EMatch pointsCorrect matchEMatch pointsCorrect matchEMatch pointsCorrect matchE
      a-19.8392/40/553.16
      a-210.21182/744.08443.93
      a-38.14202/50/333.75
      a-410.18251/51/552.78
      a-515.071832.6552/442.38
      b-174.79190/60/444.55
      b-2191.55170/52/554.74
      b-3191.28130/60/552.95
      b-488.64130/61/553.34
      b-5138.46120/41/553.51
      c-1115.18141/41/442.94
      c-2154.13260/62/442.49
      c-3124.37170/60/333.42
      c-4107.5590/744.41444.30
      c-5149.23131/60/442.70
    Tools

    Get Citation

    Copy Citation Text

    Ying ZHU, Ming ZHAO. Registration of Laser Point Cloud and Optical Image in Urban Area Based on Semantic Segmentation[J]. Acta Photonica Sinica, 2021, 50(1): 188

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: --

    Accepted: --

    Published Online: Mar. 12, 2021

    The Author Email:

    DOI:10.3788/gzxb20215001.0110002

    Topics