Laser & Optoelectronics Progress, Volume. 59, Issue 18, 1815010(2022)

3D Reconstruction and Semantic Segmentation Method Combining PointNet and 3D-LMNet from Single Image

Hui Chen1、*, Yong Tong1, Li Zhu1, and Weibin Liang2
Author Affiliations
  • 1School of Automation Engineering, Shanghai University of Electric Power, Shanghai 200090, China
  • 2Open AI Lab (Shanghai) Co., Ltd., Shanghai 200233, China
  • show less
    Figures & Tables(7)
    Flow diagram of network structure
    Schematic diagram of segmentation loss. (a) Forward loss; (b) backward loss
    Effect of different a value on CD, EMD and mIoU. (a) CD; (b) EMD; (c) mIoU
    Qualitative results on airplanes from ShapeNet. (a) Input image; (b) ground truth; (c) 3D-LMNet; (d) 3D-LMNet+PointNet; (e) our model
    Qualitative results on cars from ShapeNet. (a) Input image; (b) ground truth; (c) 3D-LMNet; (d) 3D-LMNet+PointNet; (e) our model
    Qualitative results on chairs from ShapeNet. (a) Input image; (b) ground truth; (c) 3D-LMNet; (d) 3D-LMNet+PointNet; (e) our model
    • Table 1. Experimental results on ShapeNet

      View table

      Table 1. Experimental results on ShapeNet

      CategoryMetric3D-LMNet+PointNetOur model
      AirplaneCD3.343.01
      EMD4.774.18
      mIoU62.9871.12
      CarCD4.554.26
      EMD4.103.85
      mIoU60.0161.68
      ChairCD6.415.91
      EMD8.027.83
      mIoU79.1582.03
      MeanCD4.774.39
      EMD5.635.29
      mIoU67.3871.61
    Tools

    Get Citation

    Copy Citation Text

    Hui Chen, Yong Tong, Li Zhu, Weibin Liang. 3D Reconstruction and Semantic Segmentation Method Combining PointNet and 3D-LMNet from Single Image[J]. Laser & Optoelectronics Progress, 2022, 59(18): 1815010

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Jun. 15, 2021

    Accepted: Aug. 10, 2021

    Published Online: Aug. 29, 2022

    The Author Email: Chen Hui (chenhui@shiep.edu.cn)

    DOI:10.3788/LOP202259.1815010

    Topics