Laser & Optoelectronics Progress, Volume. 58, Issue 4, 0415010(2021)

Algorithm for Stereo Matching Based on Multi-Task Learning

Yufeng Wang1,2, Hongwei Wang2,3、*, Yu Liu2, Mingquan Yang2, and Jicheng Quan1,2、*
Author Affiliations
  • 1University of Naval Aviation, Yantai, Shandong 264001, China
  • 2Aviation University of Air Force, Changchun, Jilin 130022, China
  • 3Information Engineering University, Zhengzhou, Henan 450001, China
  • show less

    The introduction of auxiliary task information is helpful for the stereo matching model to understand the related knowledge, but the complexity of model training increases. In order to solve the problem of dependence on extra label data during model training, we proposed an algorithm based on multi-task learning for stereo matching by using the autocorrelation of binocular images. This algorithm introduces the edge and feature consistency information in the multi-level progressive refinement process and updates the disparity map in a cyclic and iterative manner. According to the local smoothness of disparity and the consistency of left and right features of binocular images, a loss function is constructed to guide the model to learn the edge and feature consistency information without relying on additional label data. A spatial pyramid pooling with scale attention is proposed to enable the model to determine the importance of different scale features based on the local image features in different areas. The experimental results show that the introduction of auxiliary tasks not only improves the accuracy of disparity maps, but also provides a significant basis for the trusted regions of disparity maps. It can also be used to determine the single-view visible areas in unsupervised learning. The proposed algorithm has certain competitiveness in terms of accuracy and operating efficiency on the KITTI2015 test dataset.

    Tools

    Get Citation

    Copy Citation Text

    Yufeng Wang, Hongwei Wang, Yu Liu, Mingquan Yang, Jicheng Quan. Algorithm for Stereo Matching Based on Multi-Task Learning[J]. Laser & Optoelectronics Progress, 2021, 58(4): 0415010

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Apr. 16, 2020

    Accepted: Apr. 25, 2020

    Published Online: Feb. 26, 2021

    The Author Email: Wang Hongwei (jicheng_quan@126.com), Quan Jicheng (jicheng_quan@126.com)

    DOI:10.3788/LOP202158.0415010

    Topics