Acta Optica Sinica, Volume. 42, Issue 15, 1515001(2022)
Triplet Network Based on Dynamic Feature Attention for Object Tracking
Considering the fast motion, illumination variation, and scale transform of tracking targets in actual scenarios, a triplet network based on a dynamic feature attention (DFA) model for object tracking is proposed to solve these problems. Specifically, on the basis of the SiamRPN++ tracking framework, an online update triplet network with dynamic template branches is designed to strengthen the semantic information of extracted features and improve the matching similarity between template features and search features. A sample generation method for the triplet network training is developed to change the allocation of negative samples and improve the balance of positive and negative training samples. Moreover, a DFA model, where the historical dynamic features of the templates are enhanced through equivalent self-attention and mutual attention operation, is designed to achieve the adaptive refinement of template features. Meanwhile, the channel attention score is used to control the weight distribution of the search feature maps, and the response of the score maps is improved. Compared with the state-of-the-art algorithms such as SiamRPN++ and SiamBAN, the proposed algorithm has achieved the highest success rate (71.0%) and the best robustness (0.122) on the OTB100 and VOT2018 datasets that contain scenes with motion blur, illumination variation, and similar background interference. This algorithm also can meet the requirement of real-time target tracking.
Get Citation
Copy Citation Text
Zishuo Zhang, Yong Song, Xin Yang, Yufei Zhao, Ya Zhou. Triplet Network Based on Dynamic Feature Attention for Object Tracking[J]. Acta Optica Sinica, 2022, 42(15): 1515001
Category: Machine Vision
Received: Jan. 13, 2022
Accepted: Mar. 7, 2022
Published Online: Aug. 4, 2022
The Author Email: Song Yong (yongsong@bit.edu.cn)