Electronics Optics & Control, Volume. 31, Issue 12, 78(2024)

Transformer-Based Scale-Adaptive Hyperspectral Target Tracker

HUANG Kunpeng1... WEI Yuqing1, YU Jie2, DOU Yetian1, XU Huanyu2, ZHAO Dong1 and WANG Qing1 |Show fewer author(s)
Author Affiliations
  • 1Wuxi University, School of Electronics and Information Engineering, Wuxi 214000, China
  • 2Wuxi University, School of Internet of Things Engineering, Wuxi 214000, China
  • show less

    In the field of hyperspectral target tracking, the continuous variation in target scale leads to diverse appearances of tracked objects between consecutive frames, resulting in a decline in tracking accuracy. To address the challenge of target scale variations, a Transfomer-based Scale-adaptive Hyperspectral target Tracker (TSHT) is proposed. The method aims to significantly improve the accuracy of hyperspectral target tracking. Firstly, principal component analysis is applied to hyperspectral images to obtain three-band images. Subsequently, the search images is preprocessed by SwinBlock-Crop25, and then the template image and the preprocessed search image are input into the D-swin feature extraction module for the extraction of multi-block and multi-layer deep features. Following that, the obtained features are concatenated and subjected to a self-attention mechanism to better capture critical information about the target at different scales. Finally, through a multi-layer perceptron, the search image features processed by self-attention are mapped to the final target bounding box, completing the target tracking process. Experimental results demonstrate that TSHT exhibits high success rates and accuracy. In comparison with several state-of-the-art trackers, it outperforms the advanced target tracking algorithm MixFormer by 0.9 percentage points in handling challenges related to target scale variations, while maintaining real-time performance.

    Tools

    Get Citation

    Copy Citation Text

    HUANG Kunpeng, WEI Yuqing, YU Jie, DOU Yetian, XU Huanyu, ZHAO Dong, WANG Qing. Transformer-Based Scale-Adaptive Hyperspectral Target Tracker[J]. Electronics Optics & Control, 2024, 31(12): 78

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Dec. 14, 2023

    Accepted: Dec. 25, 2024

    Published Online: Dec. 25, 2024

    The Author Email:

    DOI:10.3969/j.issn.1671-637x.2024.12.012

    Topics