Acta Optica Sinica, Volume. 42, Issue 15, 1515001(2022)

Triplet Network Based on Dynamic Feature Attention for Object Tracking

Zishuo Zhang1,2, Yong Song1,2、*, Xin Yang1,2, Yufei Zhao1,2, and Ya Zhou1,2
Author Affiliations
  • 1School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
  • 2Beijing Key Laboratory for Precision Optoelectronic Measurement Instrument and Technology, Beijing 100081, China
  • show less

    Considering the fast motion, illumination variation, and scale transform of tracking targets in actual scenarios, a triplet network based on a dynamic feature attention (DFA) model for object tracking is proposed to solve these problems. Specifically, on the basis of the SiamRPN++ tracking framework, an online update triplet network with dynamic template branches is designed to strengthen the semantic information of extracted features and improve the matching similarity between template features and search features. A sample generation method for the triplet network training is developed to change the allocation of negative samples and improve the balance of positive and negative training samples. Moreover, a DFA model, where the historical dynamic features of the templates are enhanced through equivalent self-attention and mutual attention operation, is designed to achieve the adaptive refinement of template features. Meanwhile, the channel attention score is used to control the weight distribution of the search feature maps, and the response of the score maps is improved. Compared with the state-of-the-art algorithms such as SiamRPN++ and SiamBAN, the proposed algorithm has achieved the highest success rate (71.0%) and the best robustness (0.122) on the OTB100 and VOT2018 datasets that contain scenes with motion blur, illumination variation, and similar background interference. This algorithm also can meet the requirement of real-time target tracking.

    Tools

    Get Citation

    Copy Citation Text

    Zishuo Zhang, Yong Song, Xin Yang, Yufei Zhao, Ya Zhou. Triplet Network Based on Dynamic Feature Attention for Object Tracking[J]. Acta Optica Sinica, 2022, 42(15): 1515001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Jan. 13, 2022

    Accepted: Mar. 7, 2022

    Published Online: Aug. 4, 2022

    The Author Email: Song Yong (yongsong@bit.edu.cn)

    DOI:10.3788/AOS202242.1515001

    Topics