Optics and Precision Engineering, Volume. 29, Issue 9, 2247(2021)

3D object detection based on fusion of point cloud and image by mutual attention

Jun-ying CHEN*, Tong-yao BAI, and Liang ZHAO
Author Affiliations
  • School of Information and Control Engineering, Xi'an University of Architecture and T echnology, Xi'an710055, China
  • show less
    Figures & Tables(4)
    Structure diagram of the neural network for 3D object detection based on fusion of image and point cloud by mutual attention
    Rendering results of 8 test samples
    • Table 1. Detection parameters related to car objects

      View table
      View in Article

      Table 1. Detection parameters related to car objects

      ParametersCar
      Range[-3,1][-40,40][0,70.4]
      Voxel sizevD,vH,vW[0.4,0.2,0.2]
      Anchor sizela,wa,ha[3.9 m,1.6 m,1.56 m]
      Centered atza-1.0 m
      Two rotations0 and 90 degrees
    • Table 2. Comparison of 3D Car detection performance on KITTI: average accuracy (AP)%

      View table
      View in Article

      Table 2. Comparison of 3D Car detection performance on KITTI: average accuracy (AP)%

      MethodModalityCar (AP-0.7)
      EasyModerateHard
      MV3D4Lidar+Img71.2962.6856.56
      PointFusion13Lidar+Img77.9263.0053.27
      VoxelNet10Lidar81.9765.4662.85
      F-PointNet16Lidar+Img83.7670.9263.65
      AVOD-FPN22Lidar+Img84.4174.4468.65
      ContFuse17Lidar+Img86.3273.2567.81
      PointRCNN11Lidar86.7576.0574.30
      PointPillars12Lidar87.2276.9573.52

      Painted

      VoxelNet18

      Lidar+Img87.1576.6674.75
      MANet(ours)Lidar+Img88.7677.6376.14
    Tools

    Get Citation

    Copy Citation Text

    Jun-ying CHEN, Tong-yao BAI, Liang ZHAO. 3D object detection based on fusion of point cloud and image by mutual attention[J]. Optics and Precision Engineering, 2021, 29(9): 2247

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Information Sciences

    Received: Mar. 9, 2021

    Accepted: --

    Published Online: Nov. 22, 2021

    The Author Email: Jun-ying CHEN (chenjy@xauat.edu.cn)

    DOI:10.37188/OPE.20212909.2247

    Topics