Bimodal Coupling Haptic Perceptron for Accurate Contactless Gesture Perception and Material Identification

Guomin Ye; Qiang Wu; Yi Chen; Xueke Wang; Zhimin Xiang; Jingyan Duan; Yanfen Wan; Peng Yang

doi:10.1007/s42765-024-00458-w

Advanced Fiber Materials, Volume. 6, Issue 6, 00458(2024)

Bimodal Coupling Haptic Perceptron for Accurate Contactless Gesture Perception and Material Identification

Guomin Ye, Qiang Wu, Yi Chen, Xueke Wang, Zhimin Xiang, Jingyan Duan, Yanfen Wan^*, and Peng Yang^**

National Centre for International Research on Photoelectric and Energy Materials, Yunnan Key Laboratory for Micro/Nano Materials and Technology, Yunnan Key Laboratory of Electromagnetic Materials and Devices, School of Materials and Energy, Yunnan University, Kunming 650091, People’s Republic of China

show less

References(42)

[1] [1] Zarei M, Lee G, Lee SG, Cho K. Advances in biodegradable electronic skin: material progress and recent applications in sensing, robotics, and human–machine interfaces. Adv Mater. 2023;35:2203193.10.1002/adma.202203193

[2] [2] Qiao H, Sun S, Wu P. Non-equilibrium-growing aesthetic ionic skin for fingertip-like strain-undisturbed tactile sensation and texture recognition. Adv Mater. 2023;35:2300593.10.1002/adma.202300593

[3] [3] Qu X, Liu Z, Tan P, Wang C, Liu Y. Artificial tactile perception smart finger for material identification based on triboelectric sensing. Sci Adv. 2022;8:eabq2521.10.1126/sciadv.abq2521

[4] [4] Lu D, Liu T, Meng X, Luo B, Yuan J. Wearable triboelectric visual sensors for tactile perception. Adv Mater. 2023;35:2209117.10.1002/adma.202209117

[5] [5] Li L, Liu Y, Song C, Sheng S, Yang L. Wearable alignment-free microfiber-based sensor chip for precise vital signs monitoring and cardiovascular assessment. Adv Fiber Mater. 2022;4:475.10.1007/s42765-021-00121-8

[6] [6] Niu L, Wang J, Wang K, Pan H, Jiang G. High-speed sirospun conductive yarn for stretchable embedded knitted circuit and self-powered wearable device. Adv Fiber Mater. 2023;5:154.10.1007/s42765-022-00203-1

[7] [7] Wen DL, Pang YX, Huang P, Wang YL, Zhang XR. Silk fibroin-based wearable all-fiber multifunctional sensor for smart clothing. Adv Fiber Mater. 2022;4:873.10.1007/s42765-022-00150-x

[8] [8] Li D, Zhou J, Yao K, Liu S, He J. Touch IoT enabled by wireless self-sensing and haptic-reproducing electronic skin. Sci Adv. 2022;8:eade2450.10.1126/sciadv.ade2450

[9] [9] Shen Z, Zhang Z, Zhang N, Li J, Zhou P. High-stretchability, ultralow-hysteresis conducting polymer hydrogel strain sensors for soft machines. Adv Mater. 2022;34:2203650.10.1002/adma.202203650

[10] [10] Lv C, Tian C, Jiang J, Dang Y, Liu Y. Ultrasensitive linear capacitive pressure sensor with wrinkled microstructures for tactile perception. Adv Sci. 2023;10:2206807.10.1002/advs.202206807

[11] [11] Wang S, Wang X, Wang Q, Ma S, Xiao J. Flexible optoelectronic multimodal proximity/pressure/temperature sensors with low signal interference. Adv Mater. 2023;35:2304701.10.1002/adma.202304701

[12] [12] Zhu H, Luo H, Cai M, Song J. A multifunctional flexible tactile sensor based on resistive effect for simultaneous sensing of pressure and temperature. Adv Sci. 2024;11:2307693.10.1002/advs.202307693

[13] [13] Qu J, Mao B, Li Z, Xu Y, Zhou K. Recent progress in advanced tactile sensing technologies for soft grippers. Adv Funct Mater. 2023;33:2306249.10.1002/adfm.202306249

[14] [14] Zhao C, Wang Y, Tang G, Ru J, Zhu Z. Ionic flexible sensors: Mechanisms, materials, structures, and applications. Adv Funct Mater. 2022;32:2110417.10.1002/adfm.202110417

[15] [15] Wei X, Wang B, Wu Z, Wang ZL. An open-environment tactile sensing system: Toward simple and efficient material identification. Adv Mater. 2022;34:2203073.10.1002/adma.202203073

[16] [16] Ji J, Zhao W, Wang Y, Li Q, Wang G. Templated laser-induced-graphene-based tactile sensors enable wearable health monitoring and texture recognition via deep neural network. ACS Nano. 2023;17:20153.10.1021/acsnano.3c05838

[17] [17] Yang L, Wang Z, Wang H, Jin B, Meng C. Self-healing, reconfigurable, thermal-switching, transformative electronics for health monitoring. Adv Mater. 2023;35:2207742.10.1002/adma.202207742

[18] [18] Cui Z, Wang W, Xia H, Wang C, Tu J. Freestanding and scalable force-softness bimodal sensor arrays for haptic body-feature identification. Adv Mater. 2022;34:2207016.10.1002/adma.202207016

[19] [19] Pyo S, Lee J, Bae K, Sim S, Kim J. Recent progress in flexible tactile sensors for human-interactive systems: from sensors to advanced applications. Adv Mater. 2021;33:2005902.10.1002/adma.202005902

[20] [20] Liu Y, Yiu C, Song Z, Huang Y, Yao K. Electronic skin as wireless human-machine interfaces for robotic vr. Sci Adv. 2022;8:eabl6700.10.1126/sciadv.abl6700

[21] [21] Mishra S, Kim YS, Intarasirisawat J, Kwon YT, Lee Y. Soft, wireless periocular wearable electronics for real-time detection of eye vergence in a virtual reality toward mobile eye therapies. Sci Adv. 2020;6:eaay1729.10.1126/sciadv.aay1729

[22] [22] Shar A, Glass P, Park SH, Joung D. 3D printable one-part carbon nanotube-elastomer ink for health monitoring applications. Adv Funct Mater. 2023;33:2211079.10.1002/adfm.202211079

[23] [23] Sunwoo S-H, Han SI, Jung D, Kim M, Nam S. Stretchable low-impedance conductor with Ag–Au–Pt core–shell–shell nanowires and in situ formed Pt nanoparticles for wearable and implantable device. ACS Nano. 2023;17:7550.10.1021/acsnano.2c12659

[24] [24] Song K, Zhao R, Wang ZL, Yang Y. Conjuncted pyro-piezoelectric effect for self-powered simultaneous temperature and pressure sensing. Adv Mater. 2019;31:1902831.10.1002/adma.201902831

[25] [25] Shen Z, Zhu X, Majidi C, Gu G. Cutaneous ionogel mechanoreceptors for soft machines, physiological sensing, and amputee prostheses. Adv Mater. 2021;33:2102069.10.1002/adma.202102069

[26] [26] Lee JH, Kim SH, Heo JS, Kwak JY, Park CW. Heterogeneous structure omnidirectional strain sensor arrays with cognitively learned neural networks. Adv Mater. 2023;35:2208184.10.1002/adma.202208184

[27] [27] Lu Y, Kong D, Yang G, Wang R, Pang G. Machine learning-enabled tactile sensor design for dynamic touch decoding. Adv Sci. 2023;10:2303949.10.1002/advs.202303949

[28] [28] Li S, Xu J, Mu Y, Wang P, Zhu H. Fatigue-resistant and hysteresis-free composite fibers with a heterogeneous hierarchical structure. Adv Fiber Mater. 2023;5:1643.10.1007/s42765-023-00300-9

[29] [29] Wang Z, Zhou H, Liu D, Chen X, Wang D. A structural gel composite enabled robust underwater mechanosensing strategy with high sensitivity. Adv Funct Mater. 2022;32:2201396.10.1002/adfm.202201396

[30] [30] Zhu S, Li Y, Yelemulati H, Deng X, Li Y. An artificial remote tactile device with 3D depth-of-field sensation. Sci Adv. 2022;8:eabo5314.10.1126/sciadv.abo5314

[31] [31] Seo B, Cha Y, Choi Y, Kim S, Choi W. Rationally designed micropixelation-free tactile sensors via contour profile of triboelectric field propagation. Nano Energy. 2023;109: 108255.10.1016/j.nanoen.2023.108255

[32] [32] Boutry CM, Negre M, Jorda M, Vardoulis O, Chortos A. A hierarchically patterned, bioinspired e-skin able to detect the direction of applied pressure for robotics. Sci Robot. 2018;3:eaau6914.10.1126/scirobotics.aau6914

[33] [33] Li J, Li J, Tang Y, Liu Z, Zhang Z. Touchable gustation via a Hoffmeister gel iontronic sensor. ACS Nano. 2023;17:5129.10.1021/acsnano.3c00516

[34] [34] Wen F, Zhang Z, He T, Lee C. Ai enabled sign language recognition and Vr space bidirectional communication using triboelectric smart glove. Nat Commun. 2021;12:5378.10.1038/s41467-021-25637-w

[35] [35] Li Z, Ma Y, Zhang K, Wan J, Zhao D. Air permeable vibrotactile actuators for wearable wireless haptics. Adv Funct Mater. 2023;33:2211146.10.1002/adfm.202211146

[36] [36] Park J, Kang DH, Chae H, Ghosh SK, Jeong C. Frequency-selective acoustic and haptic smart skin for dual-mode dynamic/static human-machine interface. Sci Adv. 2022;8:eabj9220.10.1126/sciadv.abj9220

[37] [37] Wei C, Lin W, Liang S, Chen M, Zheng Y. An all-in-one multifunctional touch sensor with carbon-based gradient resistance elements. Nano-Micro Lett. 2022;14:131.10.1007/s40820-022-00875-9

[38] [38] Chen Z, Zhang S, Luo S, Sun F, Fang B. Tacchi: a pluggable and low computational cost elastomer deformation simulator for optical tactile sensors. IEEE Robot Autom Lett. 2023;8:1239.10.1109/LRA.2023.3237042

[39] [39] Li S, Huang J, Wang M, Deng K, Guo C. Structural electronic skin for conformal tactile sensing. Adv Sci. 2023;10:2304106.10.1002/advs.202304106

[40] [40] Shi Q, Sun Z, Le X, Xie J, Lee C. Soft robotic perception system with ultrasonic auto-positioning and multimodal sensory intelligence. ACS Nano. 2023;17:4985.10.1021/acsnano.2c12592

[41] [41] Ye G, Wan Y, Wu J, Zhuang W, Zhou Z. Multifunctional device integrating dual-temperature regulator for outdoor personal thermal comfort and triboelectric nanogenerator for self-powered human-machine interaction. Nano Energy. 2022;97: 107148.10.1016/j.nanoen.2022.107148

[42] [42] Zou H, Zhang Y, Guo L, Wang P, He X. Quantifying the triboelectric series. Nat Commun. 2019;10:1427.10.1038/s41467-019-09461-x

Tools

Get Citation

Copy Citation Text

Guomin Ye, Qiang Wu, Yi Chen, Xueke Wang, Zhimin Xiang, Jingyan Duan, Yanfen Wan, Peng Yang. Bimodal Coupling Haptic Perceptron for Accurate Contactless Gesture Perception and Material Identification[J]. Advanced Fiber Materials, 2024, 6(6): 00458

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Research Articles

Received: Mar. 22, 2024

Accepted: Jun. 16, 2024

Published Online: Jan. 23, 2025

The Author Email: Yanfen Wan (yfwan@ynu.edu.cn), Peng Yang (pyang@ynu.edu.cn)

DOI:10.1007/s42765-024-00458-w

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology