Laser & Optoelectronics Progress, Volume. 61, Issue 4, 0411005(2024)

Camera-IMU State Estimation and External Parameter Online Calibration Algorithm

Zinian Mao1, Zhifeng Zhou1、*, Yichun Shen2, and Liduan Wang3
Author Affiliations
  • 1School of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai 201620, China
  • 2Shanghai Satellite Engineering Research Institute, Shanghai 200240, China
  • 3Shanghai Si Nan Satellite Navigation Technology Co., Ltd., Shanghai 201801, China
  • show less
    References(24)

    [1] Xu C, Zhou Y J, Luo C. Visual SLAM method based on optical flow and instance segmentation for dynamic scenes[J]. Acta Optica Sinica, 42, 1415002(2022).

    [2] Zhang C, Yang Z, Xu H et al. RRVPE: a robust and real-time visual-inertial-GNSS pose estimator for aerial robot navigation[J]. Wuhan University Journal of Natural Sciences, 28, 20-28(2023).

    [3] Baheri A, Kolmanovsky I, Girard A et al. Vision-based autonomous driving: a model learning approach[C], 2520-2525(2020).

    [4] Wang X, Li W, Liang W et al. A space joint calibration method of monocular camera-IMU-manipulator[J]. Chinese Journal of Scientific Instrument, 42, 221-231(2021).

    [5] Yu Z L. Intelligent vehicle localization technology research based on vision and inertial fusion[D](2022).

    [6] Mishra S, Pandey G, Saripalli S. Target-free extrinsic calibration of a 3D-lidar and an IMU[C](2021).

    [7] Lü J H, Lou Q, Xiao J Y et al. High-precision calibration method for binocular camera with large inclination target[J]. Acta Optica Sinica, 42, 2312002(2022).

    [8] Ogata K, Tanaka H, Matsumoto Y. A robust position and posture measurement system using visual markers and an inertia measurement unit[C], 7497-7502(2020).

    [9] Wen W W, Peng X H, Li L Y et al. A review of camera calibration methods and research progress[J]. Laser & Optoelectronics Progress, 60, 1-17(2023).

    [10] Dong-Si T C, Mourikis A I. Estimator initialization in vision-aided inertial navigation with unknown camera-IMU calibration[C], 1064-1071(2012).

    [11] Li M Y, Mourikis A I. High-precision, consistent EKF-based visual-inertial odometry[J]. The International Journal of Robotics Research, 32, 690-711(2013).

    [12] Yang Z H, Zhu H B, Yin Y L et al. High-precision binocular camera calibration based on coding stereoscopic target[J]. Chinese Journal of Lasers, 50, 0604002(2023).

    [13] Yang Z F, Shen S J. Monocular visual-inertial state estimation with online initialization and camera-IMU extrinsic calibration[J]. IEEE Transactions on Automation Science and Engineering, 14, 39-51(2017).

    [14] Qin T, Li P L, Shen S J. VINS-mono: a robust and versatile monocular visual-inertial state estimator[J]. IEEE Transactions on Robotics, 34, 1004-1020(2018).

    [15] Cao L K, Xiao X H. A visual-inertial SLAM method based on rolling shutter RGB-D cameras[J]. Robot, 43, 193-202(2021).

    [16] Pan L H, Tian F Q, Ying W J et al. VI-SLAM algorithm with camera-IMU extrinsic automatic calibration and online estimation[J]. Chinese Journal of Scientific Instrument, 40, 56-67(2019).

    [17] Huang W B, Liu H. Online initialization and automatic camera-IMU extrinsic calibration for monocular visual-inertial SLAM[C], 5182-5189(2018).

    [18] Hartley R I. In defense of the eight-point algorithm[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19, 580-593(1997).

    [19] Huang X Z, Wu Y F, Li K T. An unscented Kalman filter visual SLAM algorithm based on lie group[J]. Radio Communications Technology, 48, 342-346(2022).

    [20] Lupton T, Sukkarieh S. Visual-inertial-aided navigation for high-dynamic motion in built environments without initial conditions[J]. IEEE Transactions on Robotics, 28, 61-76(2012).

    [21] Forster C, Carlone L, Dellaert F et al. On-manifold preintegration for real-time visual: inertial odometry[J]. IEEE Transactions on Robotics, 33, 1-21(2017).

    [22] Lin Y, Gao F, Qin T et al. Autonomous aerial navigation using monocular visual-inertial fusion[J]. Journal of Field Robotics, 35, 23-51(2018).

    [23] Wang K, Cao C, Ma S et al. An optimization-based multi-sensor fusion approach towards global drift-free motion estimation[J]. IEEE Sensors Journal, 21, 12228-12235(2021).

    [24] Lin W W, Gan H Y, Zhu B B et al. Visual simultaneous localization and mapping feature point matching algorithm optimization[J]. Automotive Engineer, 13-17(2021).

    Tools

    Get Citation

    Copy Citation Text

    Zinian Mao, Zhifeng Zhou, Yichun Shen, Liduan Wang. Camera-IMU State Estimation and External Parameter Online Calibration Algorithm[J]. Laser & Optoelectronics Progress, 2024, 61(4): 0411005

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems

    Received: Apr. 27, 2023

    Accepted: Jun. 5, 2023

    Published Online: Feb. 6, 2024

    The Author Email: Zhifeng Zhou (zhousjtu@126.com)

    DOI:10.3788/LOP231200

    CSTR:32186.14.LOP231200

    Topics