Infrared and Laser Engineering, Volume. 53, Issue 8, 20240199(2024)

Lowrank adaptative fine-tuning for infrared target tracking

Yuhang DAI1, Qiao LIU1, Di YUAN2, Nana FAN3, and Yunpeng LIU4
Author Affiliations
  • 1National Center for Applied Mathematics in Chongqing, Chongqing 401331, China
  • 2Guangzhou Institute of Technology, Xidian University, Guangzhou 710068, China
  • 3Academy of Military Science, Beijing 100191, China
  • 4Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110169, China
  • show less
    Figures & Tables(11)
    (a) Two-stream two-stage model with light weight relational modeling; (b) Two-stream two-stage with heavy relation modeling; (c) One-stream one-stage without extra relation
    (a) The structure of the proposed algorithm; (b) Low-rank side network; (c) Spatial feature enhancement module
    Visualization of the attention weights of search region corresponding to the center part of template after different Transformer layers
    (a) The forward and backward process of the network in fully fine-tune; (b) The forward and backward process of the network in this method
    The precision rate,normalized precision rate and success rate curve of various tracking algorithms in LSOTB-TIR-120. (a) Precision rate curves; (b) Normalized precision rate curves; (c) Success rate curve
    The precision rate and success rate curve of various tracking algorithms in PTB-TIR. (a) Precision rate curve; (b) Success rate curve
    Visualization of tracking results of different video sequences
    Tracking performance and GPU peak occupancy under various M. (a) Tracking precision and GPU peak; (b) Tracking norm precision and GPU peak occupancy; (c) Tracking success rate and GPU peak occupancy
    • Table 1. The success rate, precision rate and normalized precision rate rate of LSOTB-TIR-100

      View table
      View in Article

      Table 1. The success rate, precision rate and normalized precision rate rate of LSOTB-TIR-100

    • Table 2. The results of the proposed algorithm compares with the full fine-tuning method on LSOTB-TIR-120

      View table
      View in Article

      Table 2. The results of the proposed algorithm compares with the full fine-tuning method on LSOTB-TIR-120

      MethodParam/M%FullGPU men/GB%FullTime/h%FullSuccessPrecisionNorm precision
      Full tuning92.5100%20.1100%5.85100%73.485.578.4
      Ours0.040.04%7.9739.6%3.8766.2%73.786.078.5
    • Table 3. Analysis of ablation experiments in LSOTB-TIR-120

      View table
      View in Article

      Table 3. Analysis of ablation experiments in LSOTB-TIR-120

      TrackersrβGPU men/GBSuccess(↑)Precision(↑)
      OSTrack---70.582.9
      OSTrack+LSN1-7.67371.7(+1.2)83.2(+0.3)
      OSTrack+LSN2-7.67472.7(+2.2)84.5(+1.6)
      OSTrack+LSN4-7.67772.0(+1.5)83.7(+0.8)
      OSTrack+LSN+SFE21007.96772.8(+2.3)84.8(+1.9)
      OSTrack+LSN+SFE2107.96773.2(+2.7)85.0(+2.1)
      OSTrack+LSN+SFE(Ours)217.96773.7(+3.2)86.0(+3.1)
    Tools

    Get Citation

    Copy Citation Text

    Yuhang DAI, Qiao LIU, Di YUAN, Nana FAN, Yunpeng LIU. Lowrank adaptative fine-tuning for infrared target tracking[J]. Infrared and Laser Engineering, 2024, 53(8): 20240199

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: May. 18, 2024

    Accepted: --

    Published Online: Oct. 29, 2024

    The Author Email:

    DOI:10.3788/IRLA20240199

    Topics