Acta Optica Sinica, Volume. 41, Issue 17, 1712001(2021)

3D Imaging Method for Multi-View Structured Light Measurement Via Deep Learning Pose Estimation

Haihua Cui1、*, Tao Jiang1, Kunpeng Du2, Ronghui Guo1, and An′an Zhao2
Author Affiliations
  • 1College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu 210016, China
  • 2AVIC Xi′an Aircraft Industry Group Co., Ltd., Xi′an, Shaanxi 710089, China
  • show less
    Figures & Tables(9)
    Proposed data alignment strategy for multi-view structured light measurement
    Pose estimation based on YOLO network
    Experimental results. (a) Setup; (b) training loss and testing accuracy; (c) translation and rotation error; (d) true pose determination; (e) pose estimation visualization
    More cases presentation of object pose estimation. (a) Sphere; (b) pyramid; (c) pillars; (d) elbow
    Single-view structured light reconstruction based on the proposed system. (a) Projection image; (b) wrapping phase; (c) absolute phase; (d) 3D point cloud
    Point cloud splicing using estimated pose. (a)(d) Projection images in two views; (b)(e) pose estimation results; (c)(f) point clouds in two views; (g) data splicing result; (h) zoom-in view of box in Fig. (g)
    Data registration with estimated pose. (a)(d)Two-view registration of pillars and recess, with deep learning-based pose estimation; (b)(e) global refinement using ICP algorithm based on rough rigid transformation; (c)(f) error distributions of the final registration of fused data in Figs. (b), (e) and CAD model, where the error is determined by the point-to-model distance
    • Table 1. Error computation of pose estimation

      View table

      Table 1. Error computation of pose estimation

      ObjectSpherePyramidPillarsElbow
      Mean re-projectingerror /pixel2.5260.8461.7533.216
      Translationerror /mm3.5411.8973.0195.187
      Angle error /(°)0.850.420.551.05
    • Table 2. Error comparison of data fusion using markers and deep learning

      View table

      Table 2. Error comparison of data fusion using markers and deep learning

      ObjectSpherePyramidPillars
      Pose estimation /mm0.0650.0580.067
      Coded marker /mm0.0440.0380.046
      Error /mm0.0210.0200.023
    Tools

    Get Citation

    Copy Citation Text

    Haihua Cui, Tao Jiang, Kunpeng Du, Ronghui Guo, An′an Zhao. 3D Imaging Method for Multi-View Structured Light Measurement Via Deep Learning Pose Estimation[J]. Acta Optica Sinica, 2021, 41(17): 1712001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Instrumentation, Measurement and Metrology

    Received: Dec. 29, 2020

    Accepted: Mar. 23, 2021

    Published Online: Sep. 3, 2021

    The Author Email: Cui Haihua (cuihh@nuaa.edu.cn)

    DOI:10.3788/AOS202141.1712001

    Topics