Laser & Optoelectronics Progress, Volume. 61, Issue 8, 0837014(2024)

Real-Time Pedestrian Detection Based on Dual-Modal Relevant Image Fusion

Chengcheng Bi1,2,3, Miaohua Huang1,2,3、*, Ruoying Liu1,2,3, and Liangzi Wang1,2,3
Author Affiliations
  • 1Hubei Key Laboratory of Advanced Technology for Automotive Components, Wuhan University of Technology, Wuhan 430070, Hubei , China
  • 2Hubei Collaborative Innovation Center for Automotive Components Technology, Wuhan University of Technology, Wuhan 430070, Hubei , China
  • 3Hubei Research Center for New Energy & Intelligent Connected Vehicle, Wuhan University of Technology, Wuhan 430070, Hubei , China
  • show less
    References(23)

    [1] Luo Y, Zhang C Y, Tian Y H et al. An overview of deep learning based pedestrian detection algorithms[J]. Journal of Image and Graphics, 27, 2094-2111(2022).

    [2] Xu F L, Liu X, Fujimura K. Pedestrian detection and tracking with night vision[J]. IEEE Transactions on Intelligent Transportation Systems, 6, 63-71(2005).

    [3] Ge J F, Luo Y P, Tei G. Real-time pedestrian detection and tracking at nighttime for driver-assistance systems[J]. IEEE Transactions on Intelligent Transportation Systems, 10, 283-298(2009).

    [4] Ren S Q, He K M, Girshick R et al. Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 1137-1149(2017).

    [5] He K M, Gkioxari G, Dollar P et al. Mask R-CNN[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42, 386-397(2020).

    [6] Liu W, Anguelov D, Erhan D, Leibe B, Matas J, Sebe N et al. SSD: single shot MultiBox detector[M]. Computer vision-ECCV 2016. Lecture notes in computer science, 9905, 21-37(2016).

    [7] Redmon J, Divvala S, Girshick R et al. You only look once: unified, real-time object detection[C], 779-788(2016).

    [8] Shao Y H, Zhang D, Chu H Y et al. A review of YOLO object detection based on deep learning[J]. Journal of Electronics & Information Technology, 44, 3697-3708(2022).

    [9] He Z F, Chen G C, Chen J S et al. Multi-scale feature fusion lightweight real-time infrared pedestrian detection at night[J]. Chinese Journal of Lasers, 49, 1709002(2022).

    [10] Sun Y, Hou Z Q, Yang C et al. Object detection algorithm based on dual-modal fusion network[J]. Acta Photonica Sinica, 52, 0110002(2023).

    [11] Liu Z L, Shen X F. Yolo v5 dual-mode automatic driving small target detection method combining lite-HRNet[J]. Automotive Engineering, 44, 1511-1520, 1536(2022).

    [12] Ben Hamza A, He Y, Krim H et al. A multiscale approach to pixel-level image fusion[J]. Integrated Computer-Aided Engineering, 12, 135-146(2005).

    [13] Wang L, Li B, Tian L F. EGGDD: an explicit dependency model for multi-modal medical image fusion in shift-invariant shearlet transform domain[J]. Information Fusion, 19, 29-37(2014).

    [14] Li H, Wu X J. DenseFuse: a fusion approach to infrared and visible images[J]. IEEE Transactions on Image Processing, 28, 2614-2623(2019).

    [15] Xu H, Ma J Y, Jiang J J et al. U2Fusion: a unified unsupervised image fusion network[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 502-518(2022).

    [16] Li H, Wu X J, Kittler J. RFN-Nest: an end-to-end residual fusion network for infrared and visible images[J]. Information Fusion, 73, 72-86(2021).

    [21] Tang L F, Yuan J T, Zhang H et al. PIAFusion: a progressive infrared and visible image fusion network based on illumination aware[J]. Information Fusion, 83/84, 79-92(2022).

    [22] Jia X Y, Zhu C, Li M Z et al. LLVIP: a visible-infrared paired dataset for low-light vision[C], 3489-3497(2021).

    [23] Li H, Wu X J, Durrani T. NestFuse: an infrared and visible image fusion architecture based on nest connection and spatial/channel attention models[J]. IEEE Transactions on Instrumentation and Measurement, 69, 9645-9656(2020).

    Tools

    Get Citation

    Copy Citation Text

    Chengcheng Bi, Miaohua Huang, Ruoying Liu, Liangzi Wang. Real-Time Pedestrian Detection Based on Dual-Modal Relevant Image Fusion[J]. Laser & Optoelectronics Progress, 2024, 61(8): 0837014

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Digital Image Processing

    Received: Mar. 22, 2023

    Accepted: Apr. 23, 2023

    Published Online: Mar. 13, 2024

    The Author Email: Huang Miaohua (mh_huang@163.com)

    DOI:10.3788/LOP230933

    Topics