Laser & Optoelectronics Progress, Volume. 60, Issue 16, 1610008(2023)

Multi-Modal Pedestrian Detection Algorithm Based on Illumination Perception Weight Fusion

Keqi Liu1, Mianmian Dong1、*, Hui Gao1, Zhigang Lü1, Baoyi Guo2, and Min Pang3
Author Affiliations
  • 1School of Electronic and Information Engineering, Xi'an Technological University, Xi'an 710021, Shaanxi, China
  • 2Undergraduate College, Xi'an Technological University, Xi'an 710021, Shaanxi, China
  • 3Beijing Institute of Microelectronics Technology, Beijing 100000, China
  • show less
    References(24)

    [1] Li X, He M, Luo H B. Occluded pedestrian detection algorithm based on improved YOLOv3[J]. Acta Optica Sinica, 42, 1415003(2022).

    [2] Leng Y. Research on target recognition based on feature-level fusion of visible/infrared images[D](2019).

    [3] Ma J Y, Yu W, Liang P W et al. FusionGAN: a generative adversarial network for infrared and visible image fusion[J]. Information Fusion, 48, 11-26(2019).

    [4] Liu J J, Zhang S T, Wang S et al. Multispectral deep neural networks for pedestrian detection[C](2016).

    [5] König D, Adam M, Jarvers C et al. Fully convolutional region proposal networks for multispectral person detection[C], 243-250(2017).

    [6] Cao Y P, Guan D Y, Huang W L et al. Pedestrian detection with unsupervised multispectral feature learning using deep neural networks[J]. Information Fusion, 46, 206-217(2019).

    [7] Lee Y, Bui T D, Shin J. Pedestrian detection based on deep fusion network using feature correlation[C], 694-699(2018).

    [8] Guan D Y, Cao Y P, Yang J X et al. Fusion of multispectral data through illumination-aware deep neural networks for pedestrian detection[J]. Information Fusion, 50, 148-157(2019).

    [9] Li C Y, Song D, Tong R F et al. Illumination-aware faster R-CNN for robust multispectral pedestrian detection[J]. Pattern Recognition, 85, 161-171(2019).

    [10] Liu W, Anguelov D, Erhan D et al. SSD: single shot MultiBox detector[M]. Leibe B, Matas J, Sebe N, et al. Computer vision-ECCV 2016. Lecture notes in computer science, 9905, 21-37(2016).

    [11] He K M, Zhang X Y, Ren S Q et al. Identity mappings in deep residual networks[M]. Leibe B, Matas J, Sebe N, et al. Computer vision-ECCV 2016. Lecture notes in computer science, 9908, 630-645(2016).

    [12] Li K, Lin Y X, Wu X L et al. Small target vehicle detection based on multi-scale fusion and attention mechanism[J]. Journal of Zhejiang University (Engineering Science), 56, 2241-2250(2022).

    [13] Yu Z H. Research on multispectral pedestrian detection algorithm in all-time traffic scene[D](2021).

    [14] Wang Q L, Wu B G, Zhu P F et al. ECA-net: efficient channel attention for deep convolutional neural networks[C], 11531-11539(2019).

    [15] Zou Z Y, Gai S Y, Da F P et al. Occluded pedestrian detection algorithm based on attention mechanism[J]. Acta Optica Sinica, 41, 1515001(2021).

    [16] Zhou K L, Chen L S, Cao X. Improving multispectral pedestrian detection by addressing modality imbalance problems[M]. Vedaldi A, Bischof H, Brox T, et al. Computer vision-ECCV 2020. Lecture notes in computer science, 12363, 787-803(2020).

    [17] Wang Z T, Zhang C, Wang X T. Improved target detection and recognition algorithm based on YOLOV3[J]. Aerospace Shanghai (Chinese & English), 38, 60-70(2021).

    [18] He Z F, Chen G C, Chen J S et al. Multi-scale feature fusion lightweight infrared pedestrian real-time detection at night[J]. Chinese Journal of Lasers, 49, 1709002(2022).

    [19] Tong J R. Video target detection and tracking based on multimodal data[D](2019).

    [20] Lin T Y, Goyal P, Girshick R et al. Focal loss for dense object detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42, 318-327(2020).

    [21] Chen Y, Zhu Y. Multispectral pedestrian detection network under modal adaptive weight learning mechanism[J]. Optics and Precision Engineering, 28, 2700-2709(2020).

    [22] Shi Z, Mao L, Sun J. YOLO-based multi-modal weighted fusion pedestrian detection algorithm[J]. Computer Engineering, 47, 234-242(2021).

    [23] Hwang S, Park J, Kim N et al. Multispectral pedestrian detection: benchmark dataset and baseline[C], 1037-1045(2015).

    [24] Zhang H, Fromont E, Lefevre S et al. Multispectral fusion for object detection with cyclic fuse-and-refine blocks[C], 276-280(2020).

    Tools

    Get Citation

    Copy Citation Text

    Keqi Liu, Mianmian Dong, Hui Gao, Zhigang Lü, Baoyi Guo, Min Pang. Multi-Modal Pedestrian Detection Algorithm Based on Illumination Perception Weight Fusion[J]. Laser & Optoelectronics Progress, 2023, 60(16): 1610008

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Sep. 12, 2022

    Accepted: Nov. 8, 2022

    Published Online: Aug. 15, 2023

    The Author Email: Dong Mianmian (dong_mm@aliyun.com)

    DOI:10.3788/LOP222528

    Topics