Acta Optica Sinica, Volume. 40, Issue 2, 0215001(2020)

Binocular Stereo Matching by Combining Multiscale Local and Deep Features

Xuchu Wang1,2、*, Huihuang Liu2, and Yanmin Niu3
Author Affiliations
  • 1Key Laboratory of Optoelectronic Technology and Systems of Ministry of Education, Chongqing University, Chongqing 400040, China
  • 2College of Optoelectronic Engineering, Chongqing University, Chongqing 400040, China
  • 3College of Computer and Information Science, Chongqing Normal University, Chongqing 401331, China
  • show less
    Figures & Tables(17)
    Overall architecture of proposed binocular stereo matching method
    Construction of positive and negative samples
    Image features convoluted by Log-Gabor filter with different scales and directions
    Rotation invariant uniform LBP image features
    Fusion module of multi-scale feature image blocks
    Fast network architecture based on MC-CNN
    Loss curves of training process on two datasets. (a) KITTI2012 dataset; (b) KITTI2015 dataset
    Average error rate for different margins on KITTI2012 and KITTI2015 datasets
    Average error rate for different image patch sizes on KITTI2012 and KITTI2015 datasets
    Average error rate under different noise tolerances on KITTI2012 and KITTI2015 datasets
    Training loss curves under different sample construction methods on two datasets. (a) KITTI2012; (b) KITTI2015
    Disparity results obtained by various methods. (a) Original input image; (b) SGM; (c) MC-CNN-fast; (d) LG-LBP CNN; (e) noise CNN; (f) our method
    Disparity maps of stereo matching obtained by proposed method on KITTI2012 dataset. (a) Original left input image; (b) original right input image; (c) ground truth; (d) disparity map; (e) error graph
    Disparity maps of stereo matching obtained by proposed method on KITTI2015 dataset. (a) Original left input image; (b) original right input image; (c) ground truth; (d) disparity map; (e) error graph
    • Table 1. Average error rate comparison of disparity results of different algorithms (KITTI2012)

      View table

      Table 1. Average error rate comparison of disparity results of different algorithms (KITTI2012)

      AlgorithmAverage error rate /%
      >2 pixel>3 pixel>4 pixel>5 pixel
      SGM[18]6.525.364.383.82
      MC-CNN-fast[14]5.023.272.612.11
      LG-LBP CNN5.624.814.003.29
      Noise CNN4.983.252.622.14
      Our method5.033.232.592.10
    • Table 2. Average error rate comparison of disparity results with different algorithms (KITTI2015)

      View table

      Table 2. Average error rate comparison of disparity results with different algorithms (KITTI2015)

      AlgorithmAverage error rate /%
      >2 pixel>3 pixel>4 pixel>5 pixel
      SGM[18]10.377.135.544.71
      MC-CNN-fast[14]7.644.113.012.53
      LG-LBP CNN9.066.314.454.14
      Noise CNN7.614.103.012.51
      Our method7.584.032.982.58
    • Table 3. Time of each algorithm in training and testing processes

      View table

      Table 3. Time of each algorithm in training and testing processes

      AlgorithmSGM[18]MC-CNN-fast[14]LG-LBP CNNNoise CNNOur method
      Train runtime /h-5.65.85.66.5
      Test runtime /s141.522.011.762.06
    Tools

    Get Citation

    Copy Citation Text

    Xuchu Wang, Huihuang Liu, Yanmin Niu. Binocular Stereo Matching by Combining Multiscale Local and Deep Features[J]. Acta Optica Sinica, 2020, 40(2): 0215001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Jul. 17, 2019

    Accepted: Sep. 2, 2019

    Published Online: Jan. 2, 2020

    The Author Email: Wang Xuchu (xcwang@cqu.edu.cn)

    DOI:10.3788/AOS202040.0215001

    Topics