Optics and Precision Engineering, Volume. 32, Issue 24, 3616(2024)

Multi-feature cross UAV image detection algorithm under cross-layer attentional interaction

Zhihao ZHANG, Lixia DU, Yue HOU*, Ziwei HAO, and Jie YIN
Author Affiliations
  • College of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou730000, China
  • show less

    Aiming at the problems of complex background of aerial images, dense targets, and uneven target scale distribution in UAV traffic inspection, a multi-feature crossover under cross-layer attentional interaction (Multi-feature crossover under cross-layer attentional interaction,MCAI) UAV target detection algorithm was proposed. Firstly, an Adaptive Cross-layer Attentional Interaction (Adaptive Cross-layer Attentional Interaction,ACAI) module was designed in the backbone network part so that the model focused on the key feature regions to achieve effective screening of global key feature information, thus fading the influence of the complex background. Secondly, a deformable self-attentive encoder (Deformable Encoder, DeEncoder) was designed, which compensated for the lost target features by expanding the feature layer receptive field. Finally, in order to effectively identify tiny targets at different scales in the region, the multi-scale cross-fusion module (Multi-scale cross fusion module,MSCF) was proposed, which fused shallow spatial information and deep semantic information by combining the wavelet transform and feature representation in order to efficiently capture the fine-grained features of targets at different scales. The experimental results on the VisDrone 2019-DET, BDD-100K dataset, and LZTraffic Video dataset show that MCAI improves mAP0.5 by 3%, 2.2%, and 4.5%, respectively, compared to the RT-DETR model, which significantly improves the detection accuracy of the UAV inspection. In addition, in the cloudy and rainy scenario, the mAP0.5 of MCAI improves by 2.1% compared to the RT-DETR model, with better extreme weather robustness performance.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Zhihao ZHANG, Lixia DU, Yue HOU, Ziwei HAO, Jie YIN. Multi-feature cross UAV image detection algorithm under cross-layer attentional interaction[J]. Optics and Precision Engineering, 2024, 32(24): 3616

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Jun. 5, 2024

    Accepted: --

    Published Online: Mar. 11, 2025

    The Author Email: HOU Yue (houyue@mail.lzjtu.cn)

    DOI:10.37188/OPE.20243224.3616

    Topics