Optics and Precision Engineering, Volume. 30, Issue 22, 2901(2022)

Camera pose estimation based on 2D image and 3D point cloud fusion

Jia-le ZHOU, Bing ZHU*, and Zhi-lu WU
Author Affiliations
  • College of Electronic and Information Engineering, Harbin Institute of Technology, Harbin150001, China
  • show less

    This paper presents an estimation algorithm for the six degree-of-freedom camera pose obtained from a single RGB image in a specific environment using a combination of the known image and point cloud information. Specifically, we propose a multi-stage camera pose estimation algorithm based on dense scene regression. First, the camera pose estimation dataset is composed by combining the depth image information and Structure from Motion (SFM) algorithm. Then, for the first time, we introduce depth image retrieval into the construction of two- and three-dimensional (2D-3D) matching points. Using the proposed pose optimization function, a multi-stage camera pose estimation method is proposed. The ResNet network considerably improves the pose estimation accuracy. Experimental results indicate that the pose estimation accuracy is 82.7% on average in the open dataset 7 scenes, and 94.8% in our own dataset (estimated poses falling within the threshold of 5 cm/5°). Compared with other camera pose estimation methods, our method has better pose estimation accuracy for both our and public datasets.

    Tools

    Get Citation

    Copy Citation Text

    Jia-le ZHOU, Bing ZHU, Zhi-lu WU. Camera pose estimation based on 2D image and 3D point cloud fusion[J]. Optics and Precision Engineering, 2022, 30(22): 2901

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Information Sciences

    Received: Mar. 21, 2022

    Accepted: --

    Published Online: Nov. 28, 2022

    The Author Email: ZHU Bing (zhubing@hit.edu.cn)

    DOI:10.37188/OPE.20223022.2901

    Topics