Acta Optica Sinica, Volume. 42, Issue 14, 1415002(2022)

Visual SLAM Method Based on Optical Flow and Instance Segmentation for Dynamic Scenes

Chen Xu, Yijun Zhou, and Chen Luo*
Author Affiliations
  • School of Mechanical Engineering, Southeast University, Nanjing 211189, Jiangsu , China
  • show less

    In order to improve the accuracy and robustness of visual SLAM (Simultaneous Localization and Mapping) systems in dynamic scenes, a visual SLAM algorithm based on optical flow and instance segmentation is proposed. Aiming at the inconsistency of optical flow direction between dynamic objects and static background, feature points in the dynamic region mask can be eliminated in the original tracking thread of ORB-SLAM2 in real time. We use the existing depth map and tracking thread pose estimation information to remove the optical flow related to camera motion and then cluster the optical flow amplitude generated by the dynamic object's own motion to achieve high-precision dynamic area mask detection. The dynamic landmarks in the local mapping thread are eliminated combined with epipolar geometric constraints. Finally, the test results on TUM and KITTI datasets show that in high dynamic scenes, compared with ORB-SLAM2, Detect-SLAM, and DS-SLAM, the accuracy of the proposed algorithm is improved by 97%, 64%, and 44% on average. Compared with DynaSLAM, the accuracy has an average increase of 20% in half of the high dynamic scenes, which verifies that the proposed algorithm improves the accuracy and robustness of the system in high dynamic scenes.

    Tools

    Get Citation

    Copy Citation Text

    Chen Xu, Yijun Zhou, Chen Luo. Visual SLAM Method Based on Optical Flow and Instance Segmentation for Dynamic Scenes[J]. Acta Optica Sinica, 2022, 42(14): 1415002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Nov. 30, 2021

    Accepted: Jan. 24, 2022

    Published Online: Jul. 15, 2022

    The Author Email: Luo Chen (chenluo@seu.edu.cn)

    DOI:10.3788/AOS202242.1415002

    Topics