Acta Optica Sinica, Volume. 40, Issue 2, 0215001(2020)

Binocular Stereo Matching by Combining Multiscale Local and Deep Features

Xuchu Wang1,2、*, Huihuang Liu2, and Yanmin Niu3
Author Affiliations
  • 1Key Laboratory of Optoelectronic Technology and Systems of Ministry of Education, Chongqing University, Chongqing 400040, China
  • 2College of Optoelectronic Engineering, Chongqing University, Chongqing 400040, China
  • 3College of Computer and Information Science, Chongqing Normal University, Chongqing 401331, China
  • show less
    References(31)

    [2] Geiger A, Roser M, Urtasun R. Efficient large-scale stereo matching[M]. ∥Kimmel R, Klette R, Sugimoto A. Computer vision-ACCV 2010. Lecture notes in computer science. Berlin, Heidelberg: Springer, 6492, 25-38(2011).

    [3] Wang P, Wu F. A local stereo matching algorithm based on region growing[M]. ∥Zhang W, Yang X, Xu Z, et al. Advances on digital television and wireless multimedia communications. Communications in computer and information science. Berlin, Heidelberg: Springer, 331, 459-464(2012).

    [4] Chang X F, Zhou Z, Wang L et al. Real-time accurate stereo matching using modified two-pass aggregation and winner-take-all guided dynamic programming. [C]∥2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, May 16-19, 2011, Hangzhou, China. New York: IEEE, 73-79(2011).

    [5] Ma N, Men Y B, Men C G et al. A small baseline stereo matching method based on extended phase correlation[J]. Acta Electronica Sinica, 45, 1827-1835(2017).

    [6] Yang Y Y, Wang H B, Liu B. A new stereo matching algorithm based on adaptive window. [C]∥2012 International Conference on Systems and Informatics (ICSAI2012), May 19-20, 2012, Yantai, China. New York: IEEE, 1815-1819(2012).

    [10] Chen D M, Ardabilian M, Chen L M. A fast trilateral filter-based adaptive support weight method for stereo matching[J]. IEEE Transactions on Circuits and Systems for Video Technology, 25, 730-743(2015).

    [11] Chen J, Cai C H, Li C H. A multi-window stereo matching algorithm in rank tranform domain. [C]∥2012 IEEE 11th International Conference on Signal Processing, October 21-25, 2012, Beijing, China. New York: IEEE, 997-1000(2012).

    [12] Hirschmuller H. Accurate and efficient stereo processing by semi-global matching and mutual information. [C]∥2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), June 20-25, 2005, San Diego, CA, USA. New York: IEEE, 8624110(2005).

    [13] Žbontar J. LeCun Y. Computing the stereo matching cost with a convolutional neural network. [C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 1592-1599(2015).

    [14] Žbontar J. LeCun Y. Stereo matching by training a convolutional neural network to compare image patches[J]. Journal of Machine Learning Research, 17, 1-32(2016).

    [15] Zagoruyko S, Komodakis N. Learning to compare image patches via convolutional neural networks. [C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 4353-4361(2015).

    [16] Chen Z Y, Sun X, Wang L et al. A deep visual correspondence embedding model for stereo matching costs. [C]∥2015 IEEE International Conference on Computer Vision (ICCV), December 7-13, 2015, Santiago, Chile. New York: IEEE, 972-980(2015).

    [17] Zhang K, Lu J B, Lafruit G. Cross-based local stereo matching using orthogonal integral images[J]. IEEE Transactions on Circuits and Systems for Video Technology, 19, 1073-1079(2009).

    [18] Hirschmüller H. Stereo processing by semiglobal matching and mutual information[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 328-341(2008).

    [20] Knobelreiter P, Reinbacher C, Shekhovtsov A et al. End-to-end training of hybrid CNN-CRF models for stereo. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 1456-1465(2017).

    [21] Seki A, Pollefeys M. Patch based confidence prediction for dense disparity map[C]∥Procedings of the British Machine Vision Conference 2016, September 19-22, 2016, York, UK., 23(2016).

    [22] Poggi M, Mattoccia S. Learning to predict stereo reliability enforcing local consistency of confidence maps. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 4541-4550(2017).

    [23] Güney F, Geiger A. Displets: resolving stereo ambiguities using object knowledge. [C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 4165-4175(2015).

    [24] Kendall A, Martirosyan H, Dasgupta S et al. End-to-end learning of geometry and context for deep stereo regression. [C]∥2017 IEEE International Conference on Computer Vision (ICCV), October 22-29, 2017, Venice, Italy. New York: IEEE, 66-75(2017).

    [25] Brandao P, Mazomenos E, Stoyanov D. Widening siamese architectures for stereo matching[J]. Pattern Recognition Letters, 120, 75-81(2019).

    [26] Park H, Lee K M. Look wider to match image patches with convolutional neural networks[J]. IEEE Signal Processing Letters, 24, 1788-1792(2017).

    [27] Lenc K, Vedaldi A. Understanding image representations by measuring their equivariance and equivalence. [C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 991-999(2015).

    [28] Walia E, Verma V. Boosting local texture descriptors with Log-Gabor filters response for improved image retrieval[J]. International Journal of Multimedia Information Retrieval, 5, 173-184(2016).

    [29] Ojala T, Pietikäinen M, Mäenpää T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 971-987(2002).

    [30] Geiger A, Lenz P, Urtasun R. Are we ready for autonomous driving? The KITTI vision benchmark suite. [C]∥2012 IEEE Conference on Computer Vision and Pattern Recognition, June 16-21, 2012, Providence, RI, USA. New York: IEEE, 3354-3361(2012).

    [31] Menze M, Geiger A. Object scene flow for autonomous vehicles. [C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 3061-3070(2015).

    Tools

    Get Citation

    Copy Citation Text

    Xuchu Wang, Huihuang Liu, Yanmin Niu. Binocular Stereo Matching by Combining Multiscale Local and Deep Features[J]. Acta Optica Sinica, 2020, 40(2): 0215001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Jul. 17, 2019

    Accepted: Sep. 2, 2019

    Published Online: Jan. 2, 2020

    The Author Email: Wang Xuchu (xcwang@cqu.edu.cn)

    DOI:10.3788/AOS202040.0215001

    Topics