Infrared and Laser Engineering, Volume. 51, Issue 8, 20210702(2022)

Object point cloud classification and segmentation based on semantic information compensating global features

Sen Lin1, Zhenyu Zhao2、*, Xiaokui Ren2, and Zhiyong Tao2
Author Affiliations
  • 1School of Automation and Electrical Engineering, Shenyang Ligong University, Shenyang 110159, China
  • 2School of Electronic and Information Engineering, Liaoning Technical University, Huludao 125105, China
  • show less
    Figures & Tables(23)
    Schematic diagram of network structure and process
    Diagram of STN input conversion structure
    The structure of KNN module
    VLAD structure diagram
    Comparison of partial compensation
    Schematic diagram of edge conv feature extraction
    Edge conv feature extraction flowchart
    Edge Conv structure diagram
    Dilated conv in dynamic graph convolution
    Structure diagram of expanded edge conv
    Comparison of feature extraction
    Relationship between points and classification accuracy
    Visualization of object segmentation test results
    Object sparse point map segmentation results
    Complex scene segmentation results
    Rrelationship between density and accuracy
    Segmentation viewable under different point set densities
    • Table 1. Experimental platform configuration

      View table
      View in Article

      Table 1. Experimental platform configuration

      Environment configurationModel parameters
      NameConfigurationNameValue
      CPUIntel i7-10700 FBatch size32
      GPURTX3090Number point1024
      RAM32 GMax epoch250
      Operation systemUbuntu18.04OptimizerAdam
      LanguagePython 3.7Learning rate0.001
      Learning frameworkTensorFlow GPU 1.15.0Momentum0.9
    • Table 2. Experimental comparison of various classification algorithms of ModelNet40[13]

      View table
      View in Article

      Table 2. Experimental comparison of various classification algorithms of ModelNet40[13]

      MethodRepresentationInputEval accuracyAvg class acc
      PointNet[5]Points1024×389.2%86.2%
      PointNet++[6]Points(+normal)1024×(3+3)90.7%87.8%
      DGCNN[8]Points1024×392.2%88.9%
      PointCNN[7]Points1024×391.7%88.5%
      Pointwise[15]Points1024×391.6%89.1%
      SRN-PointNet[16]Points1024×391.5%88.6%
      GGM[17]Points1024×392.5%89.0%
      MSDGCNN[18]Points1024×391.8%88.3%
      EllNet[19]Points1024×292.6%89.0%
      OursPoints1024×392.7%89.3%
    • Table 3. Comparison of algorithm test time

      View table
      View in Article

      Table 3. Comparison of algorithm test time

      MethodSize/MBTime/sAccuracy
      PointNet[5]4078.989.2%
      PointNet++[6]12163.290.7%
      DGCNN[8]2189.792.2%
      PointCNN[7]94117.091.7%
      Ours2186.492.7%
    • Table 4. Local segmentation test results of each algorithm on the ShapeNet Part[14] data set

      View table
      View in Article

      Table 4. Local segmentation test results of each algorithm on the ShapeNet Part[14] data set

      MethodmIoUShapes IoU
      PlaneBagCapCarChairEarcupGuitarKnifeLampLaptopMotorMugPistolRocketSkateTable
      PointNet[5]83.7%83.4%78.7%82.5%74.9%89.6%73.0%91.5%85.9%80.8%95.3%65.2%93.0%81.2%57.9%72.8%80.6%
      PointNet[6]85.1%82.4%79.0%87.7%77.3%90.8%71.8%91.0%85.9%83.7%95.3%71.6%94.1%81.3%58.7%76.4%82.6%
      DGCNN[8]85.2%84.0%83.4%86.7%77.8%90.6%74.7%91.2%87.5%82.8%95.7%66.3%94.9%81.1%63.5%74.5%82.6%
      PointCNN[7]86.1%84.1%86.4%86.0%80.8%90.6%79.7%92.3%88.4%85.3%96.1%77.2%95.3%84.8%64.2%80.0%83.0%
      Pointwise[15]85.1%82.9%80.7%87.8%76.6%90.8%79.2%91.0%86.6%83.3%95.3%71.9%94.4%80.9%62.0%75.1%82.5%
      SRNPNet[16]85.3%82.4%79.8%88.1%77.9%90.7%69.6%90.9%86.3%84.0%95.4%72.2%94.9%81.3%62.1%75.9%83.2%
      GMM[17]85.2%83.9%82.8%88.0%79.8%90.7%76.8%91.3%87.6%82.6%95.5%66.6%94.8%81.8%62.6%73.8%82.6%
      MSDGCN[18]85.4%83.7%84.7%87.5%77.0%90.8%68.2%91.5%86.5%96.0%95.5%72.0%95.1%83.4%61.9%77.4%82.9%
      Ell-Net[19]85.0%82.8%81.5%87.6%76.8%90.6%78.8%90.8%86.8%86.9%95.1%71.8%94.2%80.8%61.8%75.0%82.2%
      Ours85.5%84.3%85.8%88.1%80.0%90.8%79.5%91.6%88.2%91.6%95.8%76.7%96.1%82.6%65.6%81.2%82.8%
    • Table 5. Analysis of the best \begin{document}$ K $\end{document} value

      View table
      View in Article

      Table 5. Analysis of the best \begin{document}$ K $\end{document} value

      KNN point numberAvg class accEval accuracy
      1689.5%91.4%
      2089.8%92.7%
      2589.1%91.3%
      3088.6%91.1%
      3288.5%90.8%
    • Table 6. Analysis of module impact

      View table
      View in Article

      Table 6. Analysis of module impact

      Dilated-Edge convKNN-VLADAvg class acc
      ×92.0%
      ×90.8%
      ×92.7%
    Tools

    Get Citation

    Copy Citation Text

    Sen Lin, Zhenyu Zhao, Xiaokui Ren, Zhiyong Tao. Object point cloud classification and segmentation based on semantic information compensating global features[J]. Infrared and Laser Engineering, 2022, 51(8): 20210702

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image processing

    Received: Jan. 20, 2022

    Accepted: --

    Published Online: Jan. 9, 2023

    The Author Email: Zhao Zhenyu (610685324@qq.com)

    DOI:10.3788/IRLA20210702

    Topics