Optics and Precision Engineering, Volume. 30, Issue 14, 1669(2022)
Research on 3D reconstruction of microscope imaging based on Harris-SIFT algorithm and full convolution depth prediction
To solve the problems of weak texture and reflection in the local magnification observation of jewelry, mineral, and metal samples, a multiview stereo three-dimensional (3D) reconstruction algorithm based on feature extraction is proposed. The lens of the microscope is fixed at a fixed angle, and the image sequence is obtained via a multi-angle imaging of the 3D specimen by moving the carrier platform. By combining the advantages of the Harris and SIFT algorithms, the SIFT algorithm in the original SFM reconstruction is improved to the Harris-SIFT algorithm for feature extraction and matching, which improves the performance of feature information extraction in weak texture regions of microscopic images. By using the full convolution neural network combined with the depth residual network to estimate and predict the depth of the input image, the predicted depth information is combined with the MVS depth map through the threshold method, the MVS depth map is modified, the dense point cloud of the object is reconstructed, and more point clouds are reconstructed with structural integrity. Experiments performed using a VHX-6000 digital microscope system show that the number of point clouds reconstructed using this algorithm is 31.25% higher than that reconstructed by the original MVS reconstruction algorithm, and the overall reconstruction time is reduced by 21.16%.
Get Citation
Copy Citation Text
Baoxiang ZHANG, Zhenming YU, Qiuhui YANG. Research on 3D reconstruction of microscope imaging based on Harris-SIFT algorithm and full convolution depth prediction[J]. Optics and Precision Engineering, 2022, 30(14): 1669
Category: Modern Applied Optics
Received: Mar. 4, 2022
Accepted: --
Published Online: Sep. 6, 2022
The Author Email: YU Zhenming (yumingming@ vip.sina.com)