Opto-Electronic Advances, Volume. 8, Issue 2, 240152(2025)

Multi-photon neuron embedded bionic skin for high-precision complex texture and object reconstruction perception research

Hongyu Zhou1,2、†, Chao Zhang1,2、†, Hengchang Nong1,2、†, Junjie Weng3, Dongying Wang4, Yang Yu1、*, Jianfa Zhang5, Chaofan Zhang6, Jinran Yu6, Zhaojian Zhang1, Huan Chen1, Zhenrong Zhang2, and Junbo Yang1
Author Affiliations
  • 1College of Science, National University of Defense Technology, Changsha 410073, China
  • 2Key Laboratory of Multimedia Communication and Network Technology in Guangxi, School of Computer, Electronics and Information, Guangxi University, Nanning 530004, China
  • 3College of Intelligence Science and Technology, National University of Defense Technology, Changsha 410073, China
  • 4College of Meteorology and Oceanography, National University of Defense Technology, Changsha 410073, China
  • 5Hunan Provincial Key Laboratory of Novel Nano-Optoelectronic, Information Materials and Devices, National University of Defense Technology, Changsha 410073, China
  • 6College of Advanced Interdisciplinary Studies, National University of Defense Technology, Changsha 410073, China
  • show less
    Figures & Tables(4)
    Design and fabrication of a multiphoton neuron tactile skin. (a) The design concept and spatial reconstruction workflow of the multiphotonic neuron haptic skin for simulating the tactile perception and spatial reconstruction process of human subcutaneous multitactile cell fusion. (b) Flowchart of the interaction of each module in the spatial reconstruction process of mahjong by multiphotonic neuron haptic skin. (c) The structure of the multiphotonic neuron tactile skin, which consists of three layers: a silicone contact layer, an OM array embedded PDMS sensing layer, and a glass substrate layer.
    Validation of shape and hardness recognition ability of multiphotonic tactile neurons. (a) Schematic of the force applied to a single sensing unit of a multiphotonic neuron. (b) Changes in the path of light passing through the waist region under three forces. (c) Stress and deformation diagrams (indicated by color bars) of the waist region of a single sensing unit under three forces. (d) Optical power response plots of a single sensing unit under 0 to 3 N normal contact force in steps of 0.2 N, with each force transformation held for 5 s. (e) Normal force sensitivity from 0 to 3 N, with error bars indicating slight variations in optical power from the response time. (f) Individual sensing unit optical power response when pressure (1 N) is repeatedly applied more than 5000 times. The inset shows the optical power response in one of the two time domains after zooming in. (g) Pressure recognition based on object hardness and shape for six species using FCNN machine learning algorithm. (h) Visualization of clustered data clusters. (i) Confusion matrix of the six measured objects with 100% recognition accuracy.
    Validation of the material and surface texture recognition ability of micronized multiphoton neurons. (a) Neural network structure used for fabric recognition experiments with some signal acquisition results. (b) Accuracy change graphs of the training set and test set during the neural network training process, with the final accuracy stabilized at 99% for the training set and 98.5% for the test set. (c) Confusion matrix of ten fabric classification results in the validation set with 98.5% accuracy. (d) OMAS successfully realizes model training and online recognition of fabrics with the assistance of artificial intelligence algorithms. (e) Schematic diagram of 0-9 digit Braille. (f) Experimental process of real-time signal feedback and recognition of Braille phone numbers. (g) Real-time signal acquisition and recognition of Braille phone numbers displayed on the user graphical interface.
    Recognition of mahjong and its suits based on haptic parameters combined with spatial reconstruction of robotic arm. (a–c) With the help of AI algorithms, the multiphoton neuron haptic skin successfully recognizes different objects through the differences in hardness and shape, and the results are displayed on the PC screen. (d–f) Multi-photon neuron haptic skin successfully recognizes mahjong colors by differences in surface texture, and the results are displayed on the PC screen. (g, h) Computer interface for hardness and shape recognition and surface texture recognition.
    Tools

    Get Citation

    Copy Citation Text

    Hongyu Zhou, Chao Zhang, Hengchang Nong, Junjie Weng, Dongying Wang, Yang Yu, Jianfa Zhang, Chaofan Zhang, Jinran Yu, Zhaojian Zhang, Huan Chen, Zhenrong Zhang, Junbo Yang. Multi-photon neuron embedded bionic skin for high-precision complex texture and object reconstruction perception research[J]. Opto-Electronic Advances, 2025, 8(2): 240152

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Research Articles

    Received: Jun. 21, 2024

    Accepted: Nov. 19, 2024

    Published Online: Apr. 27, 2025

    The Author Email: Yang Yu (YYu)

    DOI:10.29026/oea.2025.240152

    Topics