Infrared and Laser Engineering, Volume. 51, Issue 8, 20210651(2022)

Research on a real-time odometry system integrating vision, LiDAR and IMU for autonomous driving

Yaozhong Zhao1, Jinlong Xian1, and Wei Gao2、*
Author Affiliations
  • 1Yimin Open Mine, China Huaneng Group Yimin Coal and Power Co., Hulunbeier 021134, China
  • 2Beijing Baidu Netcom Science Technology Co., Ltd., Beijing 100089, China
  • show less

    Visual/LiDAR odometry can estimate the process of an autonomous driving vehicle moving in multiple degrees of freedom based on sensor data and is an important part of the positioning and mapping system. In this paper, we propose a real-time tightly coupled odometry system that integrates vision, LiDAR, and IMU for autonomous driving vehicles and supports multiple running modes and initialization methods. The front end of the system applies a modified CUDA-based ICP for point cloud registration and traditional optical flow for vision feature tracking and uses the LiDAR points as the depth of visual features. The back end of the system applies a factor graph based on a sliding window to optimize the poses, in which state nodes are related to the poses from vision and LiDAR front end subsystems, and edges are related to preintegration of IMU. The experiments show that the system has an average relative translation accuracy of 0.2%-0.5% in urban scenes. The system with both LiDAR and visual front end subsystem is superior to a system that only contains one of them. The method proposed in this paper is of positive significance for improving the accuracy of the autonomous driving positioning and mapping systems.

    Tools

    Get Citation

    Copy Citation Text

    Yaozhong Zhao, Jinlong Xian, Wei Gao. Research on a real-time odometry system integrating vision, LiDAR and IMU for autonomous driving[J]. Infrared and Laser Engineering, 2022, 51(8): 20210651

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Lasers & Laser optics

    Received: Sep. 9, 2021

    Accepted: Nov. 2, 2021

    Published Online: Jan. 9, 2023

    The Author Email: Wei Gao (xwgaowei@163.com)

    DOI:10.3788/IRLA20210651

    Topics