Laser & Optoelectronics Progress, Volume. 60, Issue 20, 2015006(2023)

Structured Light Three-Dimensional Reconstruction Technology Based on MultiResHNet

Liting Yang*, Xiaoliang Liu, Xiuxiang Chu, and Lu Zhou
Author Affiliations
  • School of Optical Mechanical and Electrical Engineering, Zhejiang A&F University, Hangzhou 311300, Zhejiang , China
  • show less
    Figures & Tables(15)
    Traditional structured light 3D measurement system
    Principle of phase unwrapping in Gray code
    Convolutional neural network structure
    Three modules of a neural network. (a) Multi Block module; (b) Res Path module; (c) Third module
    Global guidance path network structure
    Training dataset
    Depth and error images of an object. (a)(f) Depth map; (b)(g) predicted 3D shape images predicted by U-Net; (d)(i) predicted 3D shape images predicted by MultiResHNet; (c)(h) error images measured by U-Net; (e)(j) error images measured by MultiResHNet
    Noised training dataset
    3D effect and error images of an object. (a) 3D shape image corresponding to a fringe pattern; (b) 3D shape image predicted by U-Net; (d) 3D shape image predicted by MultiResHNet; (c) error image measured by U-Net; (e) error image measured by MultiResHNet
    Neural network training dataset
    RMSE of neural networks. (a) U-Net; (b) MultiResHNet
    Visual representation of three-dimensional reconstruction of objects. (a)(e) Fringe patterns of network input; (b)(f) 3D shape images corresponding to fringe patterns; (c)(g) 3D shape images predicted by U-Net; (d)(h) 3D shape images predicted by MultiResHNet
    Error results for multiple objects. (a) Fringe patterns of network input; (b) error images predicted by U-Net; (c) error images predicted by MultiResHNet
    • Table 1. Simulation error analysis of the two networks

      View table

      Table 1. Simulation error analysis of the two networks

      ParameterU-NetMultiResHNet
      TrainingMSE0.30×10-10.19×10-1
      RMSE4.33×10-23.44×10-2
      ValidationMSE0.46×10-10.32×10-1
      RMSE5.16×10-24.37×10-2
    • Table 2. Experimental index analysis of the two networks

      View table

      Table 2. Experimental index analysis of the two networks

      NetworkRMSEMAESSIM
      U-Net0.773.985×10-10.98163
      MultiResHNet0.693.528×10-10.98764
    Tools

    Get Citation

    Copy Citation Text

    Liting Yang, Xiaoliang Liu, Xiuxiang Chu, Lu Zhou. Structured Light Three-Dimensional Reconstruction Technology Based on MultiResHNet[J]. Laser & Optoelectronics Progress, 2023, 60(20): 2015006

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Nov. 29, 2022

    Accepted: Dec. 22, 2022

    Published Online: Sep. 28, 2023

    The Author Email: Liting Yang (542655072@qq.com)

    DOI:10.3788/LOP223203

    Topics