Laser & Optoelectronics Progress, Volume. 58, Issue 14, 1415001(2021)

Stereo Matching Method Based on Gated Recurrent Unit Networks

Hongzhi Du, Teng Zhang, Yanbiao Sun, Linghui Yang, and Jigui Zhu*
Author Affiliations
  • State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, Tianjin 300072, China
  • show less

    Deep learning stereo matching method based on three-dimensional convolutional neural networks (3DCNN) is fundamental to obtain accurate disparity results. The main concern with this approach is the high demand of computational resources for achieving high accuracy. To perform stereo matching method at a low computational cost, a method based on a gated recurrent unit network is proposed herein. The proposed method performs cost aggregation by replacing the 3D convolution with a gated-loop unit structure and reduces the computational resource requirements of the network based on the characteristics of the loop structure. To ensure high disparity estimation accuracy in images with weak textures and occluded areas, the proposed method includes an encoder-decoder architecture to further enlarge the receptive field in the 3D matching cost space and effectively aggregate contextual information of multiscale matching costs using residual connections. The proposed method was evaluated on the KITTI2015 and Scene Flow datasets. Experimental results demonstrate that the accuracy of the proposed stereo matching method is close to that of 3D convolutional stereo matching method while reducing the video memory consumption by 45% and the running time by 18%, greatly alleviating the calculation burden of stereo matching.

    Tools

    Get Citation

    Copy Citation Text

    Hongzhi Du, Teng Zhang, Yanbiao Sun, Linghui Yang, Jigui Zhu. Stereo Matching Method Based on Gated Recurrent Unit Networks[J]. Laser & Optoelectronics Progress, 2021, 58(14): 1415001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Sep. 21, 2020

    Accepted: Nov. 14, 2020

    Published Online: Jul. 8, 2021

    The Author Email: Zhu Jigui (jiguizhu@tju.edu.cn)

    DOI:10.3788/LOP202158.1415001

    Topics