Opto-Electronic Engineering, Volume. 49, Issue 9, 220024(2022)

Multi target tracking based on spatial mask prediction and point cloud projection

Kangliang Lu1, Jun Xue1, and Chongben Tao1,2、*
Author Affiliations
  • 1School of Electronics and Information Engineering, Suzhou University of Science and Technology, Suzhou, Jiangsu 215009, China
  • 2Tsinghua University Suzhou Automotive Research Institute, Suzhou, Jiangsu 215134, China
  • show less
    Figures & Tables(19)
    Algorithm frame diagram
    Mask prediction module
    Prediction module
    Point cloud projection
    Calibration board effect
    Mask projection
    Input sequence RGB and mask data into the model. (a) Original sequence RGB data; (b) Corresponding sequence mask data
    Loss function curve. (a) Four definitions of loss; (b) Total algorithm loss
    PR curve comparison
    The accuracy of the three algorithms for different distance, occlusion, luminosity and ambiguity
    Performance of multiple target tracking algorithms on MOT
    Effect of Apollo dataset test
    Effect of KITTI dataset test
    Effect of BDD100K dataset test
    Effect of point cloud projection
    Experimental platform
    Effect of actual road experiment
    • Table 1. This algorithm is compared with other algorithms

      View table
      View in Article

      Table 1. This algorithm is compared with other algorithms

      MethodBackbonemsrcEpochsAPAP50AP75APSAPMAPLAPbbfps
      Mask R-CNN [19]R-50-FPN1234.656.536.615.336.349.738.08.6
      Mask R-CNNR-101-FPN1236.258.638.516.438.452.040.18.1
      Mask R-CNNR-101-FPN3638.160.940.718.440.253.442.68.7
      YOLACT-700 [21]R-101-FPN4831.250.632.812.133.347.1-23.6
      OursR-50-FPN1233.654.535.415.135.947.338.216.7
      OursR-101-FPN3637.759.140.317.940.453.042.513.7
      Ours-600R-101-FPN3635.255.937.312.437.354.940.221.7
    • Table 2. Performance index

      View table
      View in Article

      Table 2. Performance index

      MethodsMOTSAMOTSAMOTSP
        KITTI mots dataset-carsMask R-CNN74.985.885.1
      MaskTrackR-CNN [25]75.586.186.5
      Track R-CNN [26]76.286.887.2
      Ours77.687.886.3
        KITTI mots dataset-pedestrainsMask R-CNN44.663.874.1
      MaskTrack R-CNN45.964.677.9
      Track R-CNN46.865.175.7
      Ours45.365.677.0
    Tools

    Get Citation

    Copy Citation Text

    Kangliang Lu, Jun Xue, Chongben Tao. Multi target tracking based on spatial mask prediction and point cloud projection[J]. Opto-Electronic Engineering, 2022, 49(9): 220024

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Article

    Received: Mar. 22, 2022

    Accepted: --

    Published Online: Oct. 13, 2022

    The Author Email: Chongben Tao (chongbentao@usts.edu.cn)

    DOI:10.12086/oee.2022.220024

    Topics