Opto-Electronic Engineering, Volume. 48, Issue 12, 210340(2021)

Point cloud-image data fusion for road segmentation

Zhang Ying... Huang Yingping*, Guo Zhiyang and Zhang Chong |Show fewer author(s)
Author Affiliations
  • [in Chinese]
  • show less

    Road detection is the premise of vehicle automatic driving. In recent years, multi-modal data fusion based on deep learning has become a hot spot in the research of automatic driving. In this paper, convolutional neural network is used to fuse LiDAR point cloud and image datato realize road segmentation in traffic scenes. In this paper, a variety of fusion schemes at pixel level, feature level and decision level are proposed. Especially, four cross-fusion schemes are designed in feature level fusion. Various schemes are compared, and the best fusion scheme is given. In the network architecture, the semantic segmentation convolutional neural network with encoding and decoding structure is used as the basic network to cross-fuse the point cloud normal features and RGB image features at dif-ferent levels. The fused data is restored by the decoder, and finally the detection results are obtained by using the activation function. The substantial experiments have been conducted on public KITTI data set to evaluate the performance of various fusion schemes. The results show that the fusion scheme E proposed in this paper has the best segmentation performance. Compared with other road-detection methods, our method gives better overall performance.

    Tools

    Get Citation

    Copy Citation Text

    Zhang Ying, Huang Yingping, Guo Zhiyang, Zhang Chong. Point cloud-image data fusion for road segmentation[J]. Opto-Electronic Engineering, 2021, 48(12): 210340

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Received: Oct. 30, 2021

    Accepted: --

    Published Online: Aug. 6, 2022

    The Author Email: Yingping Huang (huangyingping@usst.edu.cn)

    DOI:10.12086/oee.2021.210340

    Topics