Opto-Electronic Engineering, Volume. 51, Issue 10, 240180(2024)

A 3D reconstruction method based on multi-view fusion and hand-eye coordination for objects beyond the visual field

Botao Zhang1,3、*, Zhengqiang Li1, Chaohao Hua3, Jialong Xie2, and Qiang Lu1,3
Author Affiliations
  • 1School of Automation,Hangzhou Dianzi University,Hangzhou,Zhejiang 310018,China
  • 2School of Control Science and Engineering,Shandong University,Jinan,Shandong 250061,China
  • 3International Joint Laboratory of Autonomous Robotic Systems,Hangzhou Dianzi University,Hangzhou,Zhejiang 310018,China
  • show less

    The dynamic depth camera has a limited single-frame field of view,and there is noise disturbance when stitching multiple frames. To deal with the aforementioned problems,a large-scale 3D target pose measurement and reconstruction method based on multi-view fusion is presented. This approach builds a hierarchical model of the depth camera's performance gradient,predicts the pose with a multi-view scanning method based on point cloud normal vectors,and fits 3D models of targets with height constraints RANSAC (height constraints RANSAC,HC-RANSAC). The depth camera installed on the end of the robotic manipulator scans and measures the target from various angles,and the sampled data is utilized to reconstruct the target model in the local coordinate system. Experimental results reveal that when compared to fixed-depth cameras and classical reconstruction approaches based on pan-tilt vision,the proposed approach has a larger reconstruction field of view and higher reconstruction accuracy. It can reconstruct huge targets at a close range,and get an excellent balance between field of vision and precision.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Botao Zhang, Zhengqiang Li, Chaohao Hua, Jialong Xie, Qiang Lu. A 3D reconstruction method based on multi-view fusion and hand-eye coordination for objects beyond the visual field[J]. Opto-Electronic Engineering, 2024, 51(10): 240180

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Article

    Received: Aug. 4, 2024

    Accepted: Sep. 26, 2024

    Published Online: Jan. 2, 2025

    The Author Email: Zhang Botao (张波涛)

    DOI:10.12086/oee.2024.240180

    Topics