Optics and Precision Engineering, Volume. 30, Issue 22, 2901(2022)
Camera pose estimation based on 2D image and 3D point cloud fusion
This paper presents an estimation algorithm for the six degree-of-freedom camera pose obtained from a single RGB image in a specific environment using a combination of the known image and point cloud information. Specifically, we propose a multi-stage camera pose estimation algorithm based on dense scene regression. First, the camera pose estimation dataset is composed by combining the depth image information and Structure from Motion (SFM) algorithm. Then, for the first time, we introduce depth image retrieval into the construction of two- and three-dimensional (2D-3D) matching points. Using the proposed pose optimization function, a multi-stage camera pose estimation method is proposed. The ResNet network considerably improves the pose estimation accuracy. Experimental results indicate that the pose estimation accuracy is 82.7% on average in the open dataset 7 scenes, and 94.8% in our own dataset (estimated poses falling within the threshold of 5 cm/5°). Compared with other camera pose estimation methods, our method has better pose estimation accuracy for both our and public datasets.
Get Citation
Copy Citation Text
Jia-le ZHOU, Bing ZHU, Zhi-lu WU. Camera pose estimation based on 2D image and 3D point cloud fusion[J]. Optics and Precision Engineering, 2022, 30(22): 2901
Category: Information Sciences
Received: Mar. 21, 2022
Accepted: --
Published Online: Nov. 28, 2022
The Author Email: ZHU Bing (zhubing@hit.edu.cn)