Journal of Infrared and Millimeter Waves, Volume. 44, Issue 1, 111(2025)

Synchronous object detection and matching network based on infrared binocular vision

Chang-Wen ZENG1...2,3, Zhi-Yu YANG1,2,3, Zuo-Xiao DAI1, and Ming-Jian GU13,* |Show fewer author(s)
Author Affiliations
  • 1Shanghai Institute of Technical Physics,Chinese Academy of Sciences,Shanghai 200083,China
  • 2University of Chinese Academy of Sciences,Beijing 100049,China
  • 3Shanghai Integrated Innovation Center for Space Optoelectronic Perception,Shanghai 200083,China
  • show less
    Figures & Tables(20)
    The architecture of the SODMNet
    ResNet50 backbone network
    Bottleneck structure
    Comparison of depthwise convolution and pointwise convolution with traditional convolution
    Comparison of pointwise group convolution with traditional convolution
    MBConv structure
    Structure of FPN
    Annotated infrared stereo images
    Top-down view of object imaging with a parallel stereo camera setup
    Euclidean distance calculation for feature map descriptors
    Euclidean distance calculation between right and left feature map descriptors for corresponding and adjacent rows
    Intersection and union of the object bounding boxes
    Distance from predicted center to object bounding box
    Statistical results for dataset objects:(a) Initial dataset;(b) Supplement dataset
    Confusion matrix
    The prediction results of SODMNet in different scenarios
    • Table 1. The prediction results of SODMNet under different backbone networks

      View table
      View in Article

      Table 1. The prediction results of SODMNet under different backbone networks

      BackboneclassrecallprecisionF1 scoreAPmAP
      ResNetFCOSperson0.772 70.034 10.065 30.349 20.363 0
      car0.688 70.047 80.089 40.376 7
      SODMNetperson0.668 30.916 40.772 90.656 30.748 9
      car0.849 50.934 00.889 80.841 5
      MobileNetFCOSperson0.818 20.030 90.059 50.371 60.389 0
      car0.722 60.051 30.095 80.406 4
      SODMNetperson0.632 10.914 40.747 50.621 30.719 4
      car0.826 10.932 20.875 90.817 5
      ShuffleNetFCOSperson0.812 80.041 20.078 50.320 30.358 3
      car0.704 00.055 20.102 30.396 3
      SODMNetperson0.593 20.909 30.718 00.577 10.677 3
      car0.787 80.923 50.850 30.777 6
      EfficientNetFCOSperson0.778 10.053 20.099 50.383 30.404 0
      car0.708 20.038 30.072 70.424 7
      SODMNetperson0.671 80.909 70.772 90.660 70.756 8
      car0.859 60.939 40.897 70.852 9
    • Table 2. The object matching results of SODMNet

      View table
      View in Article

      Table 2. The object matching results of SODMNet

      BackboneM_recallM_precisionM_F1 scoreM_AP
      ResNet0.666 00.860 60.750 90.577 7
      MobileNet0.626 20.875 10.730 00.553 8
      ShuffleNet0.582 70.846 00.696 00.506 3
      EfficientNet0.645 50.863 80.738 80.561 6
    • Table 3. Performance comparison of object detection between SODMNet and other methods

      View table
      View in Article

      Table 3. Performance comparison of object detection between SODMNet and other methods

      NetworkclassAPmAP
      YOLOv5person0.623 90.710 2
      car0.796 5
      Swin transformerperson0.633 40.721 1
      car0.808 7
      SODMNetperson0.656 30.748 9
      car0.841 5
    • Table 4. Results of ablation experiment

      View table
      View in Article

      Table 4. Results of ablation experiment

      InputLayersperson_APcar_APM_AP
      cls&reglocationfeats1 conv2 conv4 conv
      0.651 70.834 10.569 5
      0.656 30.841 50.577 7
      0.644 60.837 00.539 5
      0.638 30.828 40.535 5
      0.643 90.836 60.561 6
      0.636 20.831 80.569 7
    Tools

    Get Citation

    Copy Citation Text

    Chang-Wen ZENG, Zhi-Yu YANG, Zuo-Xiao DAI, Ming-Jian GU. Synchronous object detection and matching network based on infrared binocular vision[J]. Journal of Infrared and Millimeter Waves, 2025, 44(1): 111

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Interdisciplinary Research on Infrared Science

    Received: Apr. 17, 2024

    Accepted: --

    Published Online: Mar. 5, 2025

    The Author Email: GU Ming-Jian (gumingj@sina.com)

    DOI:10.11972/j.issn.1001-9014.2025.01.015

    Topics