Acta Optica Sinica, Volume. 40, Issue 9, 0915002(2020)

Real-Time Stereo Matching Algorithm with Hierarchical Refinement

Yufeng Wang1,2, Hongwei Wang2,3、**, Yu Liu2, Mingquan Yang2, and Jicheng Quan1,2、*
Author Affiliations
  • 1University of Naval Aviation, Yantai, Shandong 264001, China
  • 2Aviation University of Air Force, Changchun, Jilin 130022, China
  • 3Information Engineering University, Zhengzhou, Henan 450001, China
  • show less
    Figures & Tables(13)
    Whole architecture of proposed algorithm
    Structure of FEM
    Three DRM prototypes. (a) Prototype 1; (b) prototype 2; (c) prototype 3
    Structure of MBF
    Hierarchical results of proposed method. (a) Left image; (b) d^5; (c) d^4<
    Visual results of proposed method. (a) Left image; (b) αF=0.000; (c) αF=0.001; (d) αF=0.010; (e) αF=0.100; (f) αF=1.000
    Visual results of proposed method. (a) Left image; (b) disparity map; (c) error map; (d) local details
    • Table 1. Operating rates of proposed method under different L and bframe·s-1

      View table

      Table 1. Operating rates of proposed method under different L and bframe·s-1

      bL=2L=3L=4L=5L=6L=7
      11.68.520.826.124.023.7
      21.68.520.824.224.422.0
      31.68.320.722.723.019.9
      41.68.119.721.821.220.5
      51.68.119.521.020.620.5
      61.68.018.520.420.619.5
    • Table 2. Performance evaluation of proposed method under different L(b=3)

      View table

      Table 2. Performance evaluation of proposed method under different L(b=3)

      ParameterL=4L=5L=6L=7
      Eep/pixel1.1081.1061.1171.180
      ED1/%4.9224.8264.7724.999
    • Table 3. Performance evaluation of proposed method under different b (L=5)

      View table

      Table 3. Performance evaluation of proposed method under different b (L=5)

      Parameterb=1b=2b=3b=4b=5b=6
      Eep/pixel1.1331.1151.1061.0971.0771.089
      ED1/%4.8704.8594.8264.6684.6364.724
    • Table 4. Performance evaluation of models with different versions (L=5,b=5)

      View table

      Table 4. Performance evaluation of models with different versions (L=5,b=5)

      Prototype of DRMFEMEep/pixelED1/%frun/(frame·s-1)
      FusionSPP
      Prototype 12.58017.02821.5
      Prototype 21.5176.75319.1
      Prototype 31.0774.63621.0
      Prototype 31.1054.70721.9
      Prototype 31.1414.92424.3
    • Table 5. Performance evaluation of proposed method under different αF(L=5,b=5)

      View table

      Table 5. Performance evaluation of proposed method under different αF(L=5,b=5)

      αFEep/pixelED1/%
      0.0000.7762.926
      0.0010.7732.879
      0.0100.7852.940
      0.1000.7582.822
      1.0000.7662.853
    • Table 6. Performance evaluation of different methods on KITTI2015 test dataset

      View table

      Table 6. Performance evaluation of different methods on KITTI2015 test dataset

      MethodAllNocRuntime /s
      ED1bg /%ED1fg /%ED1all /%ED1bg /%ED1fg /%ED1all /%
      M2S_CSPN[25]1.512.881.741.402.671.610.50
      GANet-deep[26]1.483.461.811.343.111.631.80
      WSMCnetEB[23]1.724.192.131.513.571.850.39
      DeepPruner(best)[22]1.873.562.151.713.181.950.18
      PSMNet[18]1.864.622.321.714.312.140.41
      iResNet-i2[15]2.253.402.444.113.724.050.12
      CRL[14]2.483.592.672.323.122.450.47
      GC-net[17]2.216.162.872.025.582.610.90
      PBCP[10]2.588.743.612.277.713.1768.00
      SGM-Net[11]2.668.643.662.237.443.0967.00
      MC-CNN-arct[4]2.898.883.892.487.643.3367.00
      DeepPruner(fast)[22]2.323.912.592.133.432.350.06
      DispNetC[13]4.324.414.344.113.724.050.06
      MADnet[28]3.759.204.663.458.414.270.02
      Proposed2.594.802.962.224.142.540.05
    Tools

    Get Citation

    Copy Citation Text

    Yufeng Wang, Hongwei Wang, Yu Liu, Mingquan Yang, Jicheng Quan. Real-Time Stereo Matching Algorithm with Hierarchical Refinement[J]. Acta Optica Sinica, 2020, 40(9): 0915002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Nov. 1, 2019

    Accepted: Jan. 17, 2020

    Published Online: May. 6, 2020

    The Author Email: Hongwei Wang (alex19820911@126.com), Jicheng Quan (jicheng_quan@126.com)

    DOI:10.3788/AOS202040.0915002

    Topics