Optics and Precision Engineering, Volume. 33, Issue 8, 1314(2025)

Object-level dynamic simultaneous localization and mapping method fusing object detection and optical flow

Shuguang LI1, Qinmei CHEN2, Jinlong SHI1、*, Suqin BAI3, Chenggen WANG1, and Xin ZHUO1
Author Affiliations
  • 1School of Computer Science, Jiangsu University of Science and Technology, Zhenjiang22000, China
  • 2Nanjing Marine Radar Research Institute, Nanjing10046, China
  • 3Key Laboratory of Smart Airport Theory and System, Civil Aviation University of China, Tianjin0000, China
  • show less
    References(36)

    [1] MUR-ARTAL R, MONTIEL J M M, TARDÓS J D. ORB-SLAM: a versatile and accurate monocular SLAM system[J]. IEEE Transactions on Robotics, 31, 1147-1163(2015).

    [2] ENGEL J, SCHÖPS T, CREMERS D[M]. LSD-SLAM: Large-Scale Direct Monocular SLAM, 834-849(2014).

    [3] MUR-ARTAL R, TARDÓS J D. ORB-SLAM2: an open-source SLAM system for monocular, stereo, and RGB-D cameras[J]. IEEE Transactions on Robotics, 33, 1255-1262(2017).

    [4] ENGEL J, KOLTUN V, CREMERS D. Direct sparse odometry[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40, 611-625(2018).

    [5] JIA X X, ZHAO D Q, ZHANG L T et al. A visual SLAM algorithm based on adaptive inertial navigation assistant feature matching[J]. Opt. Precision Eng., 31, 621-630(2023).

         贾晓雪, 赵冬青, 张乐添. 基于自适应惯导辅助特征匹配的视觉SLAM算法[J]. 光学 精密工程, 31, 621-630(2023).

    [6] DU Z J, HUANG S S, MU T J et al. Accurate dynamic SLAM using CRF-based long-term consistency[J]. IEEE Transactions on Visualization and Computer Graphics, 28, 1745-1757(2022).

    [7] BARATH D, MATAS J. Graph-cut RANSAC[C], 6733-6741(2018).

    [8] SCONA R, JAIMEZ M, PETILLOT Y R et al. StaticFusion: background reconstruction for dense RGB-D SLAM in dynamic environments[C], 3849-3856(2018).

    [9] PALAZZOLO E, BEHLEY J, LOTTES P et al. ReFusion: 3D reconstruction in dynamic environments for RGB-D cameras exploiting residuals[C], 7855-7862(2019).

    [10] ZHANG Y, ZHANG Y, ZHANG N et al. Dynamic SLAM of binocular catadioptric panoramic camera based on inverse depth filter[J]. Opt. Precision Eng., 30, 1282(2022).

         张裕, 张越, 张宁. 基于逆深度滤波的双目折反射全景相机动态SLAM系统[J]. 光学 精密工程, 30, 1282(2022).

    [11] RUNZ M, BUFFIER M, AGAPITO L. MaskFusion: real-time recognition, tracking and reconstruction of multiple moving objects[C], 10-20(2018).

    [12] LIU Y B, MIURA J. RDS-SLAM: real-time dynamic SLAM using semantic segmentation methods[J]. IEEE Access, 9, 23772-23785(2021).

    [13] DAI W C, ZHANG Y, LI P et al. RGB-D SLAM in dynamic environments using point correlations[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 373-389(2022).

    [14] HU X G, ZHANG Y Z, CAO Z Z et al. CFP-SLAM: a real-time visual slam based on coarse-to-fine probability in dynamic environments[C], 4399-4406(2022).

    [15] WANG C G, SHI J L, ZHU H W et al. RGB-D SLAM method of dynamic scene based on instance segmentation and optical flow[J]. Opt. Precision Eng., 32, 857-867(2024).

         王成根, 史金龙, 诸皓伟. 基于实例分割与光流的动态场景RGB-D SLAM[J]. 光学 精密工程, 32, 857-867(2024).

    [16] BESCOS B, FÁCIL J M, CIVERA J et al. DynaSLAM: tracking, mapping, and inpainting in dynamic scenes[J]. IEEE Robotics and Automation Letters, 3, 4076-4083(2018).

    [17] HE K M, GKIOXARI G, DOLLÁR P et al. Mask R-CNN[C], 2980-2988(2017).

    [18] CAMPOS C, ELVIRA R, RODRÍGUEZ J J G et al. ORB-SLAM3: an accurate open-source library for visual, visual–inertial, and multimap SLAM[J]. IEEE Transactions on Robotics, 37, 1874-1890(2021).

    [19] JI T T, WANG C, XIE L H. Towards real-time semantic RGB-D SLAM in dynamic environments[C], 11175-11181(2021).

    [20] FAN Y C, ZHANG Q C, TANG Y L et al. Blitz-SLAM: a semantic SLAM in dynamic environments[J]. Pattern Recognition, 121, 108225(2022).

    [21] DVORNIK N, SHMELKOV K, MAIRAL J et al. BlitzNet: A real-time deep network for scene understanding[C], 4174-4182(2017).

    [22] HE J M, LI M R, WANG Y Y et al. OVD-SLAM: an online visual SLAM for dynamic environments[J]. IEEE Sensors Journal, 23, 13210-13219(2023).

    [23] JOCHER G, CHAURASIA A, STOKEN A et al. V7.0-YOLOV5 SOTA realtime instance segmentation[J]. Zenodo(2022).

    [24] ZHU H W, BAI S Q, SHI J L et al. IOFusion: instance segmentation and optical-flow guided 3D reconstruction in dynamic scenes[J]. The Visual Computer, 41, 799-813(2025).

    [25] QIN L, WU C, CHEN Z Y et al. RSO-SLAM: a robust semantic visual SLAM with optical flow in complex dynamic environments[J]. IEEE Transactions on Intelligent Transportation Systems, 25, 14669-14684(2024).

    [26] WANG J W, RÜNZ M, AGAPITO L. DSP-SLAM: object oriented SLAM with deep shape priors[C], 1362-1371(2021).

    [27] SUCAR E, WADA K, DAVISON A. NodeSLAM: neural object descriptors for multi-view shape reconstruction[C], 949-958(2020).

    [28] WU Y M, ZHANG Y Z, ZHU D L et al. EAO-SLAM: monocular semi-dense object slam based on ensemble data association[C], 4966-4973(2021).

    [29] ZINS M, SIMON G, BERGER M O. OA-SLAM: Leveraging objects for camera relocalization in visual SLAM[C], 720-728(2022).

    [31] HUANG J H, YANG S, MU T J et al. ClusterVO: clustering moving instances and estimating visual odometry for self and surroundings[C], 2165-2174(2020).

    [32] KUHN H W. The Hungarian method for the assignment problem[J]. Naval Research Logistics Quarterly, 2, 83-97(1955).

    [33] TIAN R, ZHANG Y Z, CAO Z Z et al. Object SLAM with robust quadric initialization and mapping for dynamic outdoors[J]. IEEE Transactions on Intelligent Transportation Systems, 24, 11080-11095(2023).

    Tools

    Get Citation

    Copy Citation Text

    Shuguang LI, Qinmei CHEN, Jinlong SHI, Suqin BAI, Chenggen WANG, Xin ZHUO. Object-level dynamic simultaneous localization and mapping method fusing object detection and optical flow[J]. Optics and Precision Engineering, 2025, 33(8): 1314

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Nov. 11, 2024

    Accepted: --

    Published Online: Jul. 1, 2025

    The Author Email: Jinlong SHI (shi_jinlong@163. com)

    DOI:10.37188/OPE.20253308.1314

    Topics