Laser & Optoelectronics Progress, Volume. 56, Issue 7, 071502(2019)

Decision-Level Fusion Tracking for Infrared and Visible Spectra Based on Deep Learning

Cong Tang1,2、*, Yongshun Ling1,2, Hua Yang1,2, Xing Yang1,2, and Wuqin Tong3
Author Affiliations
  • 1 College of Electronic Countermeasures, National University of Defense Technology, Hefei, Anhui 230037, China
  • 2 State Key Laboratory of Pulsed Power Laser Technology, Hefei, Anhui 230037, China
  • 3 South-West Electron and Telecom Technology Institute, Chengdu, Sichuan 610041, China
  • show less
    Figures & Tables(11)
    Tracking drift using several classic tracking methods. (a) Algorithm in Ref. [9]; (b) algorithm in Ref. [14]; (c) algorithm in Ref. [15]; (d) algorithm in Ref. [16]
    Infrared images dataset (examples). (a) Bicycle; (b) bus; (c) car; (d) motorbike; (e) pedestrian
    Training loss versus number of iterations
    Test accuracy versus number of iterations
    Decision-level fusion tracking for infrared and visible spectra based on deep learning
    Process of decision-level fusion tracking
    Tracking results(frame sequence number is 1, 15, 32, 55, 129, 143, 162). (a) Infrared tracking; (b) visible tracking; (c) fusion tracking infrared and visible
    Comparison of overlap score between dual-band fusion and single band tracking
    Comparison of centre location error between dual-band fusion and single band tracking
    • Table 1. mAP of five classes on infrared test datasets

      View table

      Table 1. mAP of five classes on infrared test datasets

      mAPAP
      BicycleBusCarMotorbikePerson
      0.8230.7880.8960.8640.8060.758
    • Table 2. Performance comparison between dual-band fusion tracking and single band tracking

      View table

      Table 2. Performance comparison between dual-band fusion tracking and single band tracking

      PerformanceVisibletrackingInfraredtrackingFusiontracking
      Average overlapscore /%61.866.474.0
      Average centrelocation error /pixel14.68.84.0
      Target loss rate0.230.110
    Tools

    Get Citation

    Copy Citation Text

    Cong Tang, Yongshun Ling, Hua Yang, Xing Yang, Wuqin Tong. Decision-Level Fusion Tracking for Infrared and Visible Spectra Based on Deep Learning[J]. Laser & Optoelectronics Progress, 2019, 56(7): 071502

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Sep. 18, 2018

    Accepted: Oct. 22, 2018

    Published Online: Jul. 30, 2019

    The Author Email: Tang Cong (tangcong17@nudt.edu.cn)

    DOI:10.3788/LOP56.071502

    Topics