Opto-Electronic Engineering, Volume. 51, Issue 10, 240180(2024)

A 3D reconstruction method based on multi-view fusion and hand-eye coordination for objects beyond the visual field

Botao Zhang1,3、*, Zhengqiang Li1, Chaohao Hua3, Jialong Xie2, and Qiang Lu1,3
Author Affiliations
  • 1School of Automation,Hangzhou Dianzi University,Hangzhou,Zhejiang 310018,China
  • 2School of Control Science and Engineering,Shandong University,Jinan,Shandong 250061,China
  • 3International Joint Laboratory of Autonomous Robotic Systems,Hangzhou Dianzi University,Hangzhou,Zhejiang 310018,China
  • show less
    References(33)

    [1] X Y Yu, Z Y Cheng, Y K Zhang et al. Point cloud modeling and slicing algorithm for trajectory planning of spray painting robot. Robotica, 39, 2246-2267(2021).

    [2] J M Ge, Z H Deng, Z Y Li et al. Adaptive parameter optimization approach for robotic grinding of weld seam based on laser vision sensor. Rob Comput Integr Manuf, 82, 102540(2023).

    [3] M Nigro, M Sileo, F Pierri et al. Assembly task execution using visual 3D surface reconstruction: an integrated approach to parts mating. Rob Comput Integr Manuf, 81, 102519(2023).

    [4] L Yang, Y H Liu, J Z Peng et al. A novel system for off-line 3D seam extraction and path planning based on point cloud segmentation for arc welding robot. Rob Comput Integr Manuf, 64, 101929(2020).

    [5] I D Lee, J H Seo, Y M Kim et al. Automatic pose generation for robotic 3-D scanning of mechanical parts. IEEE Trans Rob, 36, 1219-1238(2020).

    [6] J M Qian, S J Feng, M Z Xu et al. High-resolution real-time 360° 3D surface defect inspection with fringe projection profilometry. Opt Lasers Eng, 137, 106382(2021).

    [7] Z Xu, R Kang, R D Lu. 3D reconstruction and measurement of surface defects in prefabricated elements using point clouds. J Comput Civil Eng, 34, 04020033(2020).

    [8] S Zhang. High-speed 3D shape measurement with structured light methods: a review. Opt Lasers Eng, 106, 119-131(2018).

    [9] C Zuo, S J Feng, L Huang et al. Phase shifting algorithms for fringe projection profilometry: a review. Opt Lasers Eng, 109, 23-59(2018).

    [10] Z L Xiang, Q C Zhang, Z J Wu. 3D shape measurement and texture mapping method based on structured light projection. Opto-Electron Eng, 49, 220169(2022).

    [11] C Lyu, Y Bai, J Yang et al. An iterative high dynamic range image processing approach adapted to overexposure 3D scene. Opt Lasers Eng, 124, 105831(2020).

    [12] S Yang, B C Li, Y P Cao et al. Noise-resilient reconstruction of panoramas and 3D scenes using robot-mounted unsynchronized commodity RGB-D cameras. ACM Trans Graphics, 39, 152(2020).

    [13] J H Ge, J X Li, Y P Peng et al. Online 3-D modeling of complex workpieces for the robotic spray painting with low-cost RGB-D cameras. IEEE Trans Instrum Meas, 70, 5011013(2021).

    [14] X Li, F Liu, X P Shao. Research progress on polarization 3D imaging technology. J Infrared Millim Waves, 40, 248-262(2021).

    [16] Z M Zhu, X N Zeng, W Q Long et al. Three-dimensional reconstruction of polarized ambient light separation in complex illumination. Opt Express, 32, 13932-13945(2024).

    [18] D Y Chu, G H Zhang, R J Song et al. Priori knowledge assisted dynamic 3D shape measurement with fringe projection. Opto-Electron Eng, 49, 210449(2022).

    [19] C D Li, L Yu, S M Fei. Large-scale,real-time 3D scene reconstruction using visual and IMU sensors. IEEE Sens J, 20, 5597-5605(2020).

    [20] L J Ding, S G Dai, P G Mu. CAD-based path planning for 3D laser scanning of complex surface. Procedia Comput Sci, 92, 526-535(2016).

    [21] T Koutecký, D Paloušek, J Brandejs. Sensor planning system for fringe projection scanning of sheet metal parts. Measurement, 94, 60-70(2016).

    [22] R Malhan, Joseph R Jomy, P M Bhatt et al. Algorithms for improving speed and accuracy of automated three-dimensional reconstruction with a depth camera mounted on an industrial robot. J Comput Inf Sci Eng, 22, 031012(2022).

    [24] Y L Zong, J Liang, W Y Pai et al. A high-efficiency and high-precision automatic 3D scanning system for industrial parts based on a scanning path planning algorithm. Opt Lasers Eng, 158, 107176(2022).

    [25] J Gao, F Li, C Zhang et al. A method of D-type weld seam extraction based on point clouds. IEEE Access, 9, 65401-65410(2021).

    [27] P Chen, J J Ren, H X Wang et al. Equal-scale structure from motion method based on deep learning. Opto-Electron Eng, 46, 190006(2019).

    [28] J S Wang, B Tao, Z Y Gong et al. A mobile robotic measurement system for large-scale complex components based on optical scanning and visual tracking. Rob Comput Integr Manuf, 67, 102010(2021).

    [29] J S Wang, Z Y Gong, B Tao et al. A 3-D reconstruction method for large freeform surfaces based on mobile robotic measurement and global optimization. IEEE Trans Instrum Meas, 71, 5006809(2022).

    [30] S J Tao, R L Bai. Point cloud registration method based on key point optimization after downsampling. Appl Res Comput, 38, 904-907(2021).

    [32] R Y Tsai, R K Lenz. A new technique for fully autonomous and efficient 3D robotics hand/eye calibration. IEEE Trans Rob Autom, 5, 345-358(1989).

    Tools

    Get Citation

    Copy Citation Text

    Botao Zhang, Zhengqiang Li, Chaohao Hua, Jialong Xie, Qiang Lu. A 3D reconstruction method based on multi-view fusion and hand-eye coordination for objects beyond the visual field[J]. Opto-Electronic Engineering, 2024, 51(10): 240180

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Article

    Received: Aug. 4, 2024

    Accepted: Sep. 26, 2024

    Published Online: Jan. 2, 2025

    The Author Email: Zhang Botao (张波涛)

    DOI:10.12086/oee.2024.240180

    Topics