Laser & Optoelectronics Progress, Volume. 61, Issue 4, 0415002(2024)

Operation Control System for Movable Robotic Arm Based on Mixed Reality

Zeyu Dong, Zheng Liu, Yong Li*, and Likun Hu
Author Affiliations
  • School of Electrical Engineering, Guangxi University, Nanning 530004, Guangxi, China
  • show less

    To manage the problem regarding inconvenient mobile operations in the field under special conditions, we have designed a mobile robotic arm operation control system based on mixed reality. The system is categorized into three modules: human-computer interaction, mechanical drive, and virtual reality. The human-computer interaction module delivers corresponding operation instructions after recognizing the body gestures of the operator via camera. These operating instructions are then analyzed by the mechanical drive module that provides the working status of the equipment. Furthermore, this feedback information is received by the virtual reality module, which then restores the operation of the equipment in the built virtual scene to realize its real-time monitoring. The test results on a mobile robot platform show that the operator can achieve remote precise control and real-time monitoring of the mobile robot arm through the proposed system, and the system response speed can reach 60?100 ms/frame.

    Tools

    Get Citation

    Copy Citation Text

    Zeyu Dong, Zheng Liu, Yong Li, Likun Hu. Operation Control System for Movable Robotic Arm Based on Mixed Reality[J]. Laser & Optoelectronics Progress, 2024, 61(4): 0415002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Dec. 2, 2022

    Accepted: Feb. 7, 2023

    Published Online: Feb. 26, 2024

    The Author Email: Li Yong (yongli@gxu.edu.cn)

    DOI:10.3788/LOP223235

    Topics