Researching | Multimodal LiDAR Enhancement Algorithm Based on Multiscale Features

Laser & Optoelectronics Progress, Volume. 61, Issue 18, 1815006(2024)

Multimodal LiDAR Enhancement Algorithm Based on Multiscale Features

Yikai Luo, Linyuan He^*, and shiping Ma

Author Affiliations

Aeronautical Engineering College, Air Force Engineering University, Xi'an 710038, Shannxi, China

show less

Abstract Get PDF(in Chinese)

Figures&Tables (10)

References (37)

Paper Information

References(37)

[1] Charles R Q, Hao S, Mo K C et al. PointNet: deep learning on point sets for 3D classification and segmentation[C], 77-85(2017).

[2] Charles R Q, Yi L, Su H et al. PointNet++: deep hierarchical feature learning on point sets in a metric space[EB/OL]. https://arxiv.?org/abs/1706.02413

[3] Wang Y, Sun Y B, Liu Z W et al. Dynamic graph CNN for learning on point clouds[J]. ACM Transactions on Graphics, 38, 146(2019).

[4] Shi S S, Wang X G, Li H S. PointRCNN: 3D object proposal generation and detection from point cloud[C], 770-779(2019).

[5] Li B. 3D fully convolutional network for vehicle detection in point cloud[C], 1513-1518(2017).

[6] Zhou Y, Tuzel O. VoxelNet: end-to-end learning for point cloud based 3D object detection[C], 4490-4499(2018).

[7] Zhou Y, Sun P, Zhang Y et al. End-to-end multi-view fusion for 3D object detection in LiDAR point clouds[EB/OL]. https://arxiv.?org/abs/1910.06528

[8] Lang A H, Vora S, Caesar H et al. PointPillars: fast encoders for object detection from point clouds[C], 12689-12697(2019).

[9] Yin T W, Zhou X Y, Krähenbühl P. Center-based 3D object detection and tracking[C], 11779-11788(2021).

[10] Shi S S, Guo C X, Jiang L et al. PV-RCNN: point-voxel feature set abstraction for 3D object detection[C], 10526-10535(2020).

[11] Meyer G P, Laddha A, Kee E et al. LaserNet: an efficient probabilistic 3D object detector for autonomous driving[C], 12669-12678(2019).

[12] Liang Z D, Zhang M, Zhang Z H et al. RangeRCNN: towards fast and accurate 3D object detection with range image representation[EB/OL]. https://arxiv.org/abs/2009.00206v2

[13] Li J N, Wang Z, Xu T F. Three-dimensional object detection technology based on point cloud data[J]. Acta Optica Sinica, 43, 1515001(2023).

[14] Pang S, Morris D, Radha H. CLOCs: camera-LiDAR object candidates fusion for 3D object detection[EB/OL]. https://arxiv.org/abs/2009.00784

[15] Wu T, Hu J, Ye L et al. A pedestrian detection algorithm based on score fusion for multi-LiDAR systems[J]. Sensors, 21, 1159(2021).

[16] Huang T T, Liu Z, Chen X W et al. EPNet: enhancing point features with image semantics for 3D object detection[EB/OL]. https://arxiv.org/abs/2007.08856v1

[17] Yoo J H, Kim Y, Kim J, Vedaldi A, Bischof H, Brox T et al. 3D-CVF: generating joint camera and LiDAR features using cross-view spatial feature fusion for 3D object detection[M]. Computer vision-ECCV 2020. Lecture notes in computer science, 12372, 720-736(2020).

[18] Xu D F, Anguelov D, Jain A. PointFusion: deep sensor fusion for 3D bounding box estimation[C], 244-253(2018).

[19] Vora S, Lang A H, Helou B et al. PointPainting: sequential fusion for 3D object detection[C], 4603-4611(2020).

[20] Hu J, An Y P, Xu W C et al. 3D object detection based on deep semantics and position information fusion of laser point cloud[J]. Chinese Journal of Lasers, 50, 1010003(2023).

[21] Zhao L, Hu J, Liu H et al. Deep learning based on semantic segmentation for three-dimensional object detection from point clouds[J]. Chinese Journal of Lasers, 48, 1710004(2021).

[22] Philion J. LiftFidler S., splat, shoot: encoding images from arbitrary camera rigs by implicitly unprojecting to 3D[EB/OL]. https://arxiv.org/abs/2008.05711v1

[23] Hu H T, Wang F Y, Su J W et al. EA-LSS: edge-aware lift-splat-shot framework for 3D bev object detection[EB/OL]. https://arxiv.org/abs/2303.17895v4

[24] Gunn J, Lenyk Z, Sharma A et al. Lift-attend-splat: bird’‍s-eye-view camera-lidar fusion using transformers[EB/OL]. https://arxiv.?org/abs/2312.14919

[25] He K M, Zhang X Y, Ren S Q et al. Deep residual learning for image recognition[C], 770-778(2016).

[26] Bai X Y, Hu Z Y, Zhu X G et al. TransFusion: robust LiDAR-camera fusion for 3D object detection with transformers[C], 1080-1089(2022).

[27] Wang Y, Guizilini V, Zhang T Y et al. DETR 3D: 3D object detection from multi-view images via 3D-to-2D queries[EB/OL]. https://arxiv.org/abs/2110.06922

[28] Caesar H, Bankiti V, Lang A H et al. nuScenes: a multimodal dataset for autonomous driving[EB/OL]. https://arxiv.org/abs/1903.11027

[29] Lin T Y, Dollár P, Girshick R et al. Feature pyramid networks for object detection[C], 936-944(2017).

[30] Zong Z F, Jiang D Z, Song G L et al. Temporal enhanced training of multi-view 3D object detector via historical object prediction[C], 3758-3767(2023).

[31] Liu H S, Teng Y, Lu T et al. SparseBEV: high-performance sparse 3D object detection from multi-camera videos[C], 18534-18544(2023).

[32] Zhang D K, Zheng Z J, Niu H Y et al. Fully sparse transformer 3-D detector for LiDAR point cloud[J]. IEEE Transactions on Geoscience and Remote Sensing, 61, 5705212(2023).

[33] Chen Y L, Yu Z D, Chen Y K et al. FocalFormer3D: focusing on hard instance for 3D object detection[C], 8360-8371(2023).

[34] Liang T T, Xie H W, Yu K C et al. BEVFusion: a simple and robust LiDAR-camera fusion framework[EB/OL]. http://arxiv.?org/abs/2205.13790v3

[35] Hu H T, Wang F Y, Su J W et al. EA-LSS: edge-aware Lift-splat-shot framework for 3D bev object detection[EB/OL]. http://arxiv.org/abs/2303.17895v4

[36] Hu C, Zheng H, Li K et al. FusionFormer: a multi-sensory fusion in bird’s-eye-view and temporal consistent transformer for 3D object detection[EB/OL]. https://arxiv.org/abs/2309.05257

[37] Yan J J, Liu Y F, Sun J J et al. Cross modal transformer: towards fast and robust 3D object detection[C], 18222-18232(2023).

Tools

Get Citation

Copy Citation Text

Yikai Luo, Linyuan He, shiping Ma. Multimodal LiDAR Enhancement Algorithm Based on Multiscale Features[J]. Laser & Optoelectronics Progress, 2024, 61(18): 1815006

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Machine Vision

Received: Mar. 1, 2024

Accepted: Apr. 18, 2024

Published Online: Sep. 14, 2024

The Author Email: Linyuan He (hal1983@163.com)

DOI:10.3788/LOP240778

CSTR:32186.14.LOP240778

Topics

laser devices and laser physics

Lasers and Laser Optics

laser manufacturing

Instrumentation, Measurement and Metrology