Opto-Electronic Advances, Volume. 6, Issue 10, 230076(2023)

Knot-inspired optical sensors for slip detection and friction measurement in dexterous robotic manipulation

Jing Pan1, Qi Wang1, Shuaikang Gao1, Zhang Zhang1, Yu Xie1, Longteng Yu1、*, and Lei Zhang1,2、**
Author Affiliations
  • 1Research Center for Humanoid Sensing, Zhejiang Lab, Hangzhou 311100, China
  • 2State Key Laboratory of Modern Optical Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou 310027, China
  • show less
    Figures & Tables(5)
    Overview of the OFN sensor. (a) Schematic diagram of the OFN sensing system. (b) 5 by 5 OFN sensing array. (c) Photographs of the output light when the sensor was untouched, (d) subjected to normal force, and (e) subjected to both normal and frictional force. (f) Finite element simulations of strain distribution when the OFN sensor (knot diameter: 3.5 mm, side length: 5 mm, thickness: 1 mm) was untouched, (g) subjected to a 10 N normal force, and (h) subjected to a 10 N normal force and an additional 4 N frictional force, respectively.
    Characterization of normal and frictional force sensing. (a) Schematic diagram of the friction testing system. (b) Responses to normal force of OFN sensors with knot diameters of 4.5 mm, 3.5 mm and 2.5 mm. (c) Responses to frictional force of OFN sensors with a diameter of 2.5 mm when pre-loaded with 0 N, 2.5 N, 5 N, 7.5 N and 10 N normal forces. (d) Intensity signals of the OFN sensor loaded/unloaded with normal and frictional forces. (e, f) Intensity signals during cyclical loading of normal force and frictional force, respectively.
    Adaptive grasping based on slip detection when the slip feedback is ON and OFF, respectively. (a, e) Snapshots during the experiments. Yellow arrows indicate slips of the cup while green arrows indicate closing of the robotic hand. (b, f) Real-time signals of the OFN sensors. (c, g) Real-time scores calculated by the Slip Finder program. Slip Score = 1: a slip occurred, Slip Score = 0: no slips. (d, h) Real-time position of the robotic fingers. Position = 0: fully open, Position = 255: fully closed.
    Characterization of tri-axial force sensing. (a) Schematic diagram of the tri-axial force testing system. (b–d) Stress distribution and responses of OFN sensors with knot diameters of 4.5 mm, 3.5 mm, and 2.5 mm to Fx, Fy, and Fz, respectively.
    Dexterous manipulation based on tri-axial force sensing. (a) Exploded diagram of the robotic tactile finger. (b) Positions of the five OFN sensors inside the finger. (c) Schematic diagram of force decomposition. (d) Photograph of two robotic tactile fingers. (e, f) The tri-axial force sensing signals and snapshots during the cutting experiment and the unlocking experiment, respectively.
    Tools

    Get Citation

    Copy Citation Text

    Jing Pan, Qi Wang, Shuaikang Gao, Zhang Zhang, Yu Xie, Longteng Yu, Lei Zhang. Knot-inspired optical sensors for slip detection and friction measurement in dexterous robotic manipulation[J]. Opto-Electronic Advances, 2023, 6(10): 230076

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Research Articles

    Received: May. 8, 2023

    Accepted: Aug. 9, 2023

    Published Online: Mar. 13, 2024

    The Author Email: Longteng Yu (LTYu), Lei Zhang (LZhang)

    DOI:10.29026/oea.2023.230076

    Topics