Acta Optica Sinica, Volume. 41, Issue 24, 2415002(2021)

Time Calibration Method for Vision Sensor and Inertial Sensor

Fengjie Fu1,2、*, Chenmao Li1, Li Wu1, Yanqing Liu1, Dongchen Zhu1, Jiamao Li1,2, and Xiaolin Zhang1,2,3
Author Affiliations
  • 1State Key Laboratory of Transducer Technology-Bionic Vision System Laboratory, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China
  • 2University of Chinese Academy of Sciences, Beijing 100049, China
  • 3School of Information Science and Technology, ShanghaiTech University, Shanghai 201210, China
  • show less
    References(22)

    [1] Shi J H, Meng Q H, Dai X Y. Loop closure detection of visual SLAM based on improved LBD and data-dependent measure[J]. Laser & Optoelectronics Progress, 58, 0615001(2021).

    [2] Sun Y L, Wu Q X. An improved simultaneous localization and mapping system[J]. Laser & Optoelectronics Progress, 56, 161013(2019).

    [3] Xu G F, Zeng J C, Liu X X. Visual odometer based on optical flow method and feature matching[J]. Laser & Optoelectronics Progress, 57, 201501(2020).

    [4] Cadena C, Carlone L, Carrillo H et al. Past, present, and future of simultaneous localization and mapping: toward the robust-perception age[J]. IEEE Transactions on Robotics, 32, 1309-1332(2016).

    [5] Corke P, Lobo J, Dias J. An introduction to inertial and visual sensing[J]. The International Journal of Robotics Research, 26, 519-535(2007).

    [6] Liu R X, Shen J, Chen C et al. SLAM for robotic navigation by fusing RGB-D and inertial data in recurrent and convolutional neural networks[C]∥2019 IEEE 5th International Conference on Mechatronics System and Robots (IC msR), May 3-5, 2019, Singapore., 1-6(2019).

    [7] Huang G Q. Visual-, 9572-9582(2019).

    [8] Zheng F, Liu Y H. SE(2)-constrained visual inertial fusion for ground vehicles[J]. IEEE Sensors Journal, 18, 9699-9707(2018).

    [9] Xiao J H, Xiong D, Yu Q H et al. A real-time sliding-window-based visual-inertial odometry for MAVs[J]. IEEE Transactions on Industrial Informatics, 16, 4049-4058(2020).

    [10] Miiller M G, Steidle F, Schuster M J et al. Robust visual-inertial state estimation with multiple odometries and efficient mapping on an MAV with ultra-wide FOV stereo vision[C]∥2018 IEEE/RSJ International Conference on Intelligent Robots and Syste ms (IROS), October 1-5, 2018, Madrid, Spain., 3701-3708(2018).

    [11] Chen C, Zhu H, Li M G et al. A review of visual-inertial simultaneous localization and mapping from filtering-based and optimization-based perspectives[J]. Robotics, 7, 45(2018).

    [12] Alves J, Lobo J, Dias J. Camera-inertial sensor modelling and alignment for visual navigation[J]. Machine Intelligence and Robotic Control, 5, 103-112(2003).

    [13] Lobo J, Dias J. Relative pose calibration between visual and inertial sensors[J]. The International Journal of Robotics Research, 26, 561-575(2007).

    [14] [14] HarrisonA, NewmanP. TICSync: knowing when things happened[C]∥2011 IEEE International Conference on Robotics and Automation, May 9-13, 2011, Shanghai, China. New York: IEEE Press, 2011: 356- 363.

    [15] Mair E, Fleps M, Suppa M et al. Spatio-temporal initialization for IMU to camera registration[C]∥2011 IEEE International Conference on Robotics and Biomimetics, December 7-11, 2011, Karon Beach, Thailand., 557-564(2011).

    [16] Kelly J, Sukhatme G S. Ageneral framework for temporal calibration of multiple proprioceptive and exteroceptive sensors[M]. ∥Khatib O, Kumar V, Sukhatme G. Experimental robotics. Springer tracts in advanced robotics. Heidelberg: Springer, 79, 195-209(2014).

    [17] [17] EnglishA, RossP, BallD, et al.TriggerSync: a time synchronisation tool[C]∥2015 IEEE International Conference on Robotics and Automation (ICRA), May 26-30, 2015, Seattle, WA, USA. New York: IEEE Press, 2015: 6220- 6226.

    [18] Furgale P, Barfoot T D, Sibley G. Continuous-time batch estimation using temporal basis functions[C]∥2012 IEEE International Conference on Robotics and Automation, May 14-18, 2012, Saint Paul, MN, USA., 2088-2095(2012).

    [19] Furgale P, Rehder J, Siegwart R. Unified temporal and spatial calibration for multi-sensor syste ms[C]∥2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, November 3-7, 2013, Tokyo, Japan., 1280-1286(2013).

    [20] Furgale P, Sommer H, Maye J et al. -10-23)[2021-06-10]. http: ∥github.com/ethz-asl/kalibr/wiki/camera-imu-calibration.(2018).

    [21] Nikolic J, Rehder J, Burri M et al. A synchronized visual-inertial sensor system with FPGA pre-processing for accurate real-time SLAM[C]∥2014 IEEE International Conference on Robotics and Automation (ICRA), May 31-June 7, 2014, Hong Kong, China., 431-437(2014).

    [22] Fu F J, Wu L, Guo Y B, device of image sensor, inertial sensor: CN109922260A[P] et al. -06-21(2019).

    Tools

    Get Citation

    Copy Citation Text

    Fengjie Fu, Chenmao Li, Li Wu, Yanqing Liu, Dongchen Zhu, Jiamao Li, Xiaolin Zhang. Time Calibration Method for Vision Sensor and Inertial Sensor[J]. Acta Optica Sinica, 2021, 41(24): 2415002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: May. 24, 2021

    Accepted: Jun. 28, 2021

    Published Online: Dec. 10, 2021

    The Author Email: Fu Fengjie (fengjiefu@mail.sim.ac.cn)

    DOI:10.3788/AOS202141.2415002

    Topics