Opto-Electronic Engineering, Volume. 51, Issue 3, 230317-1(2024)

Image-guided and point cloud space-constrained method for detection and localization of abandoned objects on the road

Huaiyu Cai1...2, Zhaoqian Yang1,2, Ziyang Cui1,2, Yi Wang1,2, and Xiaodong Chen12,* |Show fewer author(s)
Author Affiliations
  • 1School of Precision Instrument and Opto-electronics Engineering, Tianjin University, Tianjin 300072, China
  • 2Key Laboratory of Optoelectronic Information Technology Ministry of Education, Tianjin University, Tianjin 300072, China
  • show less

    Abandoned objects on the road significantly impact traffic safety. To address issues such as missed detections, false alarms, and localization difficulties encountered in detecting of small-to-medium-sized abandoned objects, this paper proposes a method for detecting and locating abandoned objects on the road using image guidance and point cloud spatial constraints. The method employs an improved YOLOv7-OD network to process image data, extracting information about two-dimensional target bounding boxes. Subsequently, these bounding boxes are projected onto the coordinate system of the LiDAR sensor to get a pyramidal region of interest (ROI). Under the spatial constraints of the point cloud within the ROI, the detection and localization results of abandoned objects on the road in three-dimensional space are obtained through a combination of point cloud clustering and point cloud generation algorithms. The experimental results show that the improved YOLOv7-OD network achieves recall and average precision rates of 85.4% and 82.0%, respectively, for medium-sized objects, representing an improvement of 6.6% and 8.0% compared to the YOLOv7. The recall and average precision rates for small-sized objects are 66.8% and 57.3%, respectively, with an increase of 5.3%. Regarding localization, for targets located 30-40 m away from the detecting vehicle, the depth localization error is 0.19 m, and the angular localization error is 0.082°, enabling the detection and localization of multi-scale abandoned objects on the road.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Huaiyu Cai, Zhaoqian Yang, Ziyang Cui, Yi Wang, Xiaodong Chen. Image-guided and point cloud space-constrained method for detection and localization of abandoned objects on the road[J]. Opto-Electronic Engineering, 2024, 51(3): 230317-1

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Article

    Received: Dec. 27, 2023

    Accepted: Mar. 1, 2024

    Published Online: Jul. 8, 2024

    The Author Email: Chen Xiaodong (陈晓冬)

    DOI:10.12086/oee.2024.230317

    Topics