Advanced Fiber Materials, Volume. 6, Issue 6, 00458(2024)

Bimodal Coupling Haptic Perceptron for Accurate Contactless Gesture Perception and Material Identification

Guomin Ye... Qiang Wu, Yi Chen, Xueke Wang, Zhimin Xiang, Jingyan Duan, Yanfen Wan* and Peng Yang** |Show fewer author(s)
Author Affiliations
  • National Centre for International Research on Photoelectric and Energy Materials, Yunnan Key Laboratory for Micro/Nano Materials and Technology, Yunnan Key Laboratory of Electromagnetic Materials and Devices, School of Materials and Energy, Yunnan University, Kunming 650091, People’s Republic of China
  • show less

    A bimodal coupled multifunctional tactile perceptron for contactless gesture recognition and material identification is proposed to address the challenges posed by limited functionality, signal interference from multimodal collaborative work, and the high power consumption of traditional tactile sensors. This perceptron integrates a capacitive sensor and a triboelectric sensor symmetrically, employing an energy complementarity strategy to reduce power consumption and implementing symmetrical distribution of two sensors for physical isolation to prevent signal interference. The capacitive sensor detects external pressure, providing information on material properties such as hardness, softness, and deformation, with a wide linear response range of 0–745.3 kPa. The triboelectric sensor captures the electron affinity of measured object. Further, by utilising machine learning algorithms, a system for contactless gesture recognition and material identification is engineered. This system demonstrates a remarkable accuracy rate of 98.5% when recognising 5 gestures, and achieves a perfect identification (100%) of 10 different materials aided by incorporating capacitive and triboelectric response. These results greatly advance the progress of tactile perceptrons with high integration, low power consumption, and multifunctionality, enhancing their effectiveness and reliability in smart device applications.

    Tools

    Get Citation

    Copy Citation Text

    Guomin Ye, Qiang Wu, Yi Chen, Xueke Wang, Zhimin Xiang, Jingyan Duan, Yanfen Wan, Peng Yang. Bimodal Coupling Haptic Perceptron for Accurate Contactless Gesture Perception and Material Identification[J]. Advanced Fiber Materials, 2024, 6(6): 00458

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Research Articles

    Received: Mar. 22, 2024

    Accepted: Jun. 16, 2024

    Published Online: Jan. 23, 2025

    The Author Email: Wan Yanfen (yfwan@ynu.edu.cn), Yang Peng (pyang@ynu.edu.cn)

    DOI:10.1007/s42765-024-00458-w

    Topics