Laser & Infrared, Volume. 54, Issue 11, 1767(2024)

Enhanced target tracking algorithm with reversible multi-branch bimodal adaptive fusion

GENG Li-zhi, ZHOU Dong-ming*, WANG Chang-cheng, LIU Yi-song, and SUN Yi-qiu
Author Affiliations
  • School of Information Science and Engineering, Yunnan University, Kunming 650500, China
  • show less

    Due to the strong complementarity between visible light and infrared images, more attention has been focused on tracking through the joint information of these two modalities. However, in existing tracking algorithms, hthe inability to effectively learn the complementary information of both and mine modality-specific features limits the performance of the tracker. In responseto this issue, a reversible multibranch bimodal adaptive fusion network for tracking is proposed. Firstly, a tri-branch structured network is designed for separate learning of thermal infrared, visible light, and their shared characteristics. This design not only maximizes the utilization of shared modal information, but also preserves the differential characteristics between infrared and visible data as well as the rich detail information. Furthermore, an adaptive module for modal feature interaction is introduced to efficiently mine complementary modal information and filter out redundant data. Extensive experiments conducted on multiple public datasets proves the effectiveness of this tracker, particularly showcasing remarkable anti-interference capabilities in scenarios involving scale changes, camera shakes, and occlusion.

    Tools

    Get Citation

    Copy Citation Text

    GENG Li-zhi, ZHOU Dong-ming, WANG Chang-cheng, LIU Yi-song, SUN Yi-qiu. Enhanced target tracking algorithm with reversible multi-branch bimodal adaptive fusion[J]. Laser & Infrared, 2024, 54(11): 1767

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Dec. 22, 2023

    Accepted: Jan. 14, 2025

    Published Online: Jan. 14, 2025

    The Author Email: ZHOU Dong-ming (zhoudm@ynu.edu.cn)

    DOI:10.3969/j.issn.1001-5078.2024.11.018

    Topics