Optics and Precision Engineering, Volume. 30, Issue 14, 1669(2022)

Research on 3D reconstruction of microscope imaging based on Harris-SIFT algorithm and full convolution depth prediction

Baoxiang ZHANG1... Zhenming YU2,* and Qiuhui YANG3 |Show fewer author(s)
Author Affiliations
  • 1School of Computer,Electronics and Information,Guangxi University,Nanning530004,China
  • 2Guangxi Key Laboratory of Machine Vision and Intelligent Control,Wuzhou University, Wuzhou54300,China
  • 3School of Data Science & Software Engineering,Wuzhou University,Wuzhou54002,China
  • show less

    To solve the problems of weak texture and reflection in the local magnification observation of jewelry, mineral, and metal samples, a multiview stereo three-dimensional (3D) reconstruction algorithm based on feature extraction is proposed. The lens of the microscope is fixed at a fixed angle, and the image sequence is obtained via a multi-angle imaging of the 3D specimen by moving the carrier platform. By combining the advantages of the Harris and SIFT algorithms, the SIFT algorithm in the original SFM reconstruction is improved to the Harris-SIFT algorithm for feature extraction and matching, which improves the performance of feature information extraction in weak texture regions of microscopic images. By using the full convolution neural network combined with the depth residual network to estimate and predict the depth of the input image, the predicted depth information is combined with the MVS depth map through the threshold method, the MVS depth map is modified, the dense point cloud of the object is reconstructed, and more point clouds are reconstructed with structural integrity. Experiments performed using a VHX-6000 digital microscope system show that the number of point clouds reconstructed using this algorithm is 31.25% higher than that reconstructed by the original MVS reconstruction algorithm, and the overall reconstruction time is reduced by 21.16%.

    Tools

    Get Citation

    Copy Citation Text

    Baoxiang ZHANG, Zhenming YU, Qiuhui YANG. Research on 3D reconstruction of microscope imaging based on Harris-SIFT algorithm and full convolution depth prediction[J]. Optics and Precision Engineering, 2022, 30(14): 1669

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Modern Applied Optics

    Received: Mar. 4, 2022

    Accepted: --

    Published Online: Sep. 6, 2022

    The Author Email: YU Zhenming (yumingming@ vip.sina.com)

    DOI:10.37188/OPE.20223014.1669

    Topics