Laser & Optoelectronics Progress, Volume. 61, Issue 4, 0415002(2024)

Operation Control System for Movable Robotic Arm Based on Mixed Reality

Zeyu Dong, Zheng Liu, Yong Li*, and Likun Hu
Author Affiliations
  • School of Electrical Engineering, Guangxi University, Nanning 530004, Guangxi, China
  • show less
    Figures & Tables(17)
    Software system architecture
    Hardware system architecture
    Flowchart of d-Hash algorithm
    Flowchart of key point extraction
    Schematic of the distribution of key points[13]
    The distribution of human body key points in the spatial coordinate system
    Key point depth estimation effect display. (a) Raw image, (b) key extraction, (c) depth estimation
    Connecting rod coordinate system
    Kinematic modeling of the Mecanum wheel
    Virtual-reality module node distribution
    Scene 3D display effect
    System response speed test
    Test motion trajectory. (a) Beginning of movement; (b) moment in the middle of movement; (c) end of movement
    Motion trajectory test results
    System operation effect display. (a) Robot initialization; (b) the arm turns to the right and retracts; (c) the arm turns to the left and extends forward; (d) the arm turns to the left and clamps the gripper
    • Table 1. Robot arm D-H parameter table

      View table

      Table 1. Robot arm D-H parameter table

      Linkθdaαcos αsin α
      1θ1L1090°01
      2θ20L2010
      3θ30L3010
      4θ40L4-90°0-1
      5θ50090°01
      6θ6L50010
    • Table 2. Perception hash threshold and speed judgment

      View table

      Table 2. Perception hash threshold and speed judgment

      Test image classificationAlgorithm typeSpeed /(ms/1000 photos)Hamming distance
      Fixture controla-Hash86.065
      p-Hash225.157
      d-Hash46.035
      Flex controla-Hash80.0519
      p-Hash212.1431
      d-Hash45.0317
      Rotary controla-Hash79.0527
      p-Hash211.1443
      d-Hash45.0324
    Tools

    Get Citation

    Copy Citation Text

    Zeyu Dong, Zheng Liu, Yong Li, Likun Hu. Operation Control System for Movable Robotic Arm Based on Mixed Reality[J]. Laser & Optoelectronics Progress, 2024, 61(4): 0415002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Dec. 2, 2022

    Accepted: Feb. 7, 2023

    Published Online: Feb. 26, 2024

    The Author Email: Yong Li (yongli@gxu.edu.cn)

    DOI:10.3788/LOP223235

    CSTR:32186.14.LOP223235

    Topics