Acta Optica Sinica, Volume. 41, Issue 6, 0615002(2021)

Global-Aware Siamese Network for Thermal Infrared Object Tracking

Chang Li, Dedong Yang*, Peng Song, and Chang Guo
Author Affiliations
  • School of Artificial Intelligence, Hebei University of Technology, Tianjin 300130, China
  • show less

    At present, most thermal infrared (TIR) tracking methods are based on correlation filters or RGB trackers for feature extraction. However, both of them are only suitable for RGB object tracking but not sensitive to the TIR object features, thus failing to be applied to the TIR object tracking. To this end, a TIR object tracker based on the global-aware siamese neural network was proposed in this paper. First, the features from the last three layers of the siamese neural network were fused to obtain new features. Second, the spatial-aware module composed of the spatial transformer network and channel attention was added to get the global effective information. Simultaneously, the self-attention mechanism was introduced to make the algorithm more focus on extracting the discriminant information of the objects. At last, the final response map was acquired by response fusion of the results. The experimental results on the TIR pedestrian tracking benchmark (PTB-TIR) show that the proposed algorithm can adapt to a variety of TIR environments while maintaining a high tracking speed (20.2 frame/s), achieving effective and stable real-time tracking of TIR objects.

    Tools

    Get Citation

    Copy Citation Text

    Chang Li, Dedong Yang, Peng Song, Chang Guo. Global-Aware Siamese Network for Thermal Infrared Object Tracking[J]. Acta Optica Sinica, 2021, 41(6): 0615002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Sep. 8, 2020

    Accepted: Nov. 11, 2020

    Published Online: Apr. 7, 2021

    The Author Email: Yang Dedong (ydd12677@163.com)

    DOI:10.3788/AOS202141.0615002

    Topics