Journal of Infrared and Millimeter Waves, Volume. 44, Issue 1, 111(2025)

Synchronous object detection and matching network based on infrared binocular vision

Chang-Wen ZENG1,2,3, Zhi-Yu YANG1,2,3, Zuo-Xiao DAI1, and Ming-Jian GU1,3、*
Author Affiliations
  • 1Shanghai Institute of Technical Physics,Chinese Academy of Sciences,Shanghai 200083,China
  • 2University of Chinese Academy of Sciences,Beijing 100049,China
  • 3Shanghai Integrated Innovation Center for Space Optoelectronic Perception,Shanghai 200083,China
  • show less

    The three-dimensional perception of road objects in challenging environments is crucial for the development of autonomous vehicles that operating in all conditions, at all hours. Infrared binocular vision mimics the human binocular system, facilitating stereoscopic perception of objects in challenging conditions such as dim or zero-light environments. The core technology for stereoscopic perception in binocular vision systems is accurate object detection and matching. To streamline the complex sequence of object detection and matching procedures, a synchronous object detection and matching network (SODMNet) is proposed, which can perform synchronous detection and matching of infrared objects. SODMNet innovatively combines an object detection network with an object matching module, leveraging the deep features from the classification and regression branches as inputs for the object matching module. By concatenating these features with relative position encoding from the feature maps and processing the concatenated features through a convolutional network, the network generates feature descriptors for the left and right images. Object matching is then achieved by calculating the Euclidean distances between these descriptors, thus facilitating synchronous object detection and matching in binocular vision. In addition, a novel nighttime infrared binocular dataset, annotated with targets such as pedestrians and vehicles, is created to support the development and evaluation of the proposed network. Experimental results indicate that SODMNet achieves a significant improvement of more than 84.9% in object detection mean average precision (mAP) on this dataset, with an object matching average precision (AP) of 0.5777. These results demonstrate that SODMNet is capable of high-precision, synchronized object detection and matching in infrared binocular vision, marking a significant advancement in the field.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Chang-Wen ZENG, Zhi-Yu YANG, Zuo-Xiao DAI, Ming-Jian GU. Synchronous object detection and matching network based on infrared binocular vision[J]. Journal of Infrared and Millimeter Waves, 2025, 44(1): 111

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Interdisciplinary Research on Infrared Science

    Received: Apr. 17, 2024

    Accepted: --

    Published Online: Mar. 5, 2025

    The Author Email: GU Ming-Jian (gumingj@sina.com)

    DOI:10.11972/j.issn.1001-9014.2025.01.015

    Topics