Opto-Electronic Engineering, Volume. 51, Issue 10, 240180(2024)

A 3D reconstruction method based on multi-view fusion and hand-eye coordination for objects beyond the visual field

Botao Zhang1...3,*, Zhengqiang Li1, Chaohao Hua3, Jialong Xie2, and Qiang Lu13 |Show fewer author(s)
Author Affiliations
  • 1School of Automation,Hangzhou Dianzi University,Hangzhou,Zhejiang 310018,China
  • 2School of Control Science and Engineering,Shandong University,Jinan,Shandong 250061,China
  • 3International Joint Laboratory of Autonomous Robotic Systems,Hangzhou Dianzi University,Hangzhou,Zhejiang 310018,China
  • show less
    Figures & Tables(18)
    Performance gradient stratification diagram of the depth camera[22]
    Multi-view measurement based on depth camera
    Definition of the coordinate system for unit vectors
    Point cloud corner detection diagram
    Examples of four cases for judging the starting point of a scan. (a) Case 1; (b) Case 2; (c) Case 3; (d) Case 4
    Decision diagram for finding the starting point
    Schematic diagram of improved voxel filtering method based on the center of gravity
    Experimental platform of the proposed algorithm
    Trend diagram of error-distance variation
    Multi-view fusion of hand-eye coordination point cloud splicing
    Aligned multi-view point cloud collection
    Filtering results of the proposed method for point clouds. (a) Down sampling processing result; (b) HC-RANSAC processing result; (c) Statistical filtering processing result; (d) Moving least squares processing result
    Distribution of relative distance between corresponding points
    Alignment error distribution of multi-frame point clouds
    Comparison of different 3D reconstruction methods
    • Table 1. Experimental results of measurement error analysis

      View table
      View in Article

      Table 1. Experimental results of measurement error analysis

      数据指标实验Ⅰ实验Ⅱ实验Ⅲ实验Ⅳ实验Ⅴ实验Ⅵ实验Ⅶ
      di/m00.1990.2910.4040.5010.6921.012
      00.1990.2900.4000.5020.6971.006
      00.1990.2910.4030.4990.6951.016
      00.1990.2910.4030.5020.6951.017
      00.1990.2900.4010.5010.6941.014
      00.1990.2910.4020.4990.6961.014
      00.1990.2910.4020.5010.6881.026
      00.1990.2910.4020.5020.6951.017
      00.1990.2910.4010.5030.6901.009
      00.1990.2900.4030.4990.6871.011
      dr/m0.150.1980.2910.4030.5050.7051.047
      d¯/m00.1990.29070.40210.50090.69291.0142
      Δd/m0.150.0010.00030.00090.00410.01210.0328
      e/%100.000.510.100.220.811.723.13
      σ000.000460.001140.001380.00330.00517
    • Table 2. Hierarchical error of ranging performance

      View table
      View in Article

      Table 2. Hierarchical error of ranging performance

      测距性能层次距离过近可接受范围距离过远
      距离阈值/m( 0,0.15 ]( 0.15,0.6 )[ 0.6,∞ )
      Δd/mdi≤0.005≥0.01
      e/%100≤1>1
    • Table 3. Statistical values of distance in each direction

      View table
      View in Article

      Table 3. Statistical values of distance in each direction

      均值/m众数/m标准差
      相对距离3.69×10−65.29×10−64.20×10−6
      X方向相对距离5.39×10−5−1.48×10−57.57×10−4
      Y方向相对距离6.21×10−51.45×10−48.13×10−4
      Z方向相对距离3.29×10−4−1.54×10−31.53×10−3
    Tools

    Get Citation

    Copy Citation Text

    Botao Zhang, Zhengqiang Li, Chaohao Hua, Jialong Xie, Qiang Lu. A 3D reconstruction method based on multi-view fusion and hand-eye coordination for objects beyond the visual field[J]. Opto-Electronic Engineering, 2024, 51(10): 240180

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Article

    Received: Aug. 4, 2024

    Accepted: Sep. 26, 2024

    Published Online: Jan. 2, 2025

    The Author Email: Zhang Botao (张波涛)

    DOI:10.12086/oee.2024.240180

    Topics