Acta Photonica Sinica, Volume. 53, Issue 1, 0111002(2024)

BEV Space 3D Object Detection Algorithm Based on Fusion of Infrared Camera and LiDAR

Wuyue WANG1、*, Zhaofei XU2,3, Chunyan QU3, Ying LIN4, Yufeng CHEN4, and Jian LIAO1
Author Affiliations
  • 1Yantai Research Institute,Harbin Engineering University,Yantai 265500,China
  • 2Mechanical and Electrical Engineering Institute,Harbin Engineering University,Harbin 150000,China
  • 3Iray Optoelectronic Technology Co.,LTD,Yantai 265500,China
  • 4Electric Power Research Institute,State Grid Shandong Electric Power Company,Jinan 250014,China
  • show less
    References(24)

    [1] REN Keyan, GU Meiying, YUAN Zhengqian et al. Research review on 3D object detection for automatic driving[J]. Control and Decision, 38, 1-2(2023).

    [2] LI Ruilong. Research on 3D object detection technology in automatic driving scenario[D](2022).

    [3] LIU Z, WU Z. SMOKE: Single-stage monocular 3D object detection via keypoint estimation[C], 996-997(2020).

    [4] ZHOU Y, TUZEL O. Voxelnet: End-to-end learning for point cloud based 3D object detection[C], 4490-4499(2018).

    [5] YAN Y, MAO Y, LI B. Second: Sparsely embedded convolutional detection[J]. Sensors, 18, 3337(2018).

    [6] CHEN X, MA H, WAN J et al. Multi-view 3D object detection network for autonomous driving[C], 1907-1915(2017).

    [7] KU J, MOZIFIAN M, LEE J et al. Joint 3D proposal generation and object detection from view aggregation[C](2018).

    [8] QI C R, LIU W, WU C et al. Frustum pointnets for 3D object detection from rgb-d data[C], 918-927(2018).

    [9] QI C R, SU H, MO K et al. Pointnet: Deep learning on point sets for 3D classification and segmentation[C], 652-660(2017).

    [10] QI C R, YI L, SU H et al. PointNet++: deep hierarchical feature learning on point sets in a metric space[C], 30(2017).

    [11] VORA S, LANG A H, HELOU B et al. Pointpainting: Sequential fusion for 3d object detection[C], 4604-4612(2020).

    [12] PHILION J, FIDLER S. Lift, splat, shoot: encoding images from arbitrary camera rigs by implicitly unprojecting to 3D[C], 194-210(2020).

    [13] WANG C Y, LIAO H Y M, WU Y H et al. CSPNet: a new backbone that can enhance learning capability of CNN[C], 390-391(2020).

    [14] LIN T Y, DOLLAR P, GIRSHICK R et al. Feature pyramid networks for object detection[C], 2117-2125(2017).

    [15] LIU S, QI L, QIN H et al. Path aggregation network for instance segmentation[C], 8759-8768(2018).

    [16] HE K, ZHANG X, REN S et al. Spatial pyramid pooling in deep convolutional networks for visual recognition[C], 37, 1904-1916(2015).

    [17] LANG A H, VORA S, CAESAR H et al. Pointpillars: fast encoders for object detection from point clouds[C], 12697-12705(2019).

    [18] YIN T, ZHOU X, KRAHENBUHL P. Center-based 3D object detection and tracking[C], 11784-11793(2021).

    [19] SALTON G, MCGILL M J. Introduction to modern information retrieval[J]. McGraw-Hill(1986).

    [20] EVERINGHAM M, VAN GOOL L, WILLIAMS C K I et al. The pascal Visual Object Classes(VOC) challenge[J]. International Journal of Computer Vision(IJCV), 88, 303-338(2010).

    [21] GEIGER A, LENZ P, URTASUN R. Are we ready for Autonomous Driving?[C], 3354-3361(2012).

    [22] ZHU B, JIANG Z, ZHOU X et al. Class-balanced grouping and sampling for point cloud 3D object detection[J](2019).

    [23] ZHOU Y, SUN P, ZHANG Y et al. End-to-end multi-view fusion for 3D object detection in LiDAR point clouds[C], 923-932(2020).

    [24] SINDAGI V A, ZHOU Y, TUZEL O. Mvx-Net: multimodal voxelnet for 3d object detection[C], 7276-7282(2019).

    Tools

    Get Citation

    Copy Citation Text

    Wuyue WANG, Zhaofei XU, Chunyan QU, Ying LIN, Yufeng CHEN, Jian LIAO. BEV Space 3D Object Detection Algorithm Based on Fusion of Infrared Camera and LiDAR[J]. Acta Photonica Sinica, 2024, 53(1): 0111002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Jul. 10, 2023

    Accepted: Sep. 18, 2023

    Published Online: Feb. 1, 2024

    The Author Email: Wuyue WANG (wangwuyue@hrbeu.edu.cn)

    DOI:10.3788/gzxb20245301.0111002

    Topics