Nano-Micro Letters, Volume. 15, Issue 1, 221(2023)

Humanoid Intelligent Display Platform for Audiovisual Interaction and Sound Identification

Yang Wang1,†... Wenli Gao1,†, Shuo Yang1, Qiaolin Chen2, Chao Ye3, Hao Wang1, Qiang Zhang4, Jing Ren1, Zhijun Ning1, Xin Chen2, Zhengzhong Shao2, Jian Li1,5, Yifan Liu1,5, and Shengjie Ling15,* |Show fewer author(s)
Author Affiliations
  • 1School of Physical Science and Technology, ShanghaiTech University, 393 Middle Huaxia Road, Shanghai 201210, People’s Republic of China
  • 2State Key Laboratory of Molecular Engineering of Polymers, Department of Macromolecular Science, Laboratory of Advanced Materials, Fudan University, Shanghai 200433, People’s Republic of China
  • 3School of Textile and Clothing, Yancheng Institute of Technology, Jiangsu 224051, People’s Republic of China
  • 4School of Textile Science and Engineering, Wuhan Textile University, Wuhan 430200, People’s Republic of China
  • 5Shanghai Clinical Research and Trial Center, 201210, Shanghai, People’s Republic of China
  • show less

    This study proposes a rational strategy for the design, fabrication and system integration of the humanoid intelligent display platform (HIDP) to meet the requirements of highly humanized mechanical properties and intelligence for human–machine interfaces. The platform's sandwich structure comprises a middle light-emitting layer and surface electrodes, which consists of silicon elastomer embedded with phosphor and silk fibroin ionoelastomer, respectively. Both materials are highly stretchable and resilient, endowing the HIDP with skin-like mechanical properties and applicability in various extreme environments and complex mechanical stimulations. Furthermore, by establishing the numerical correlation between the amplitude change of animal sounds and the brightness variation, the HIDP realizes audiovisual interaction and successful identification of animal species with the aid of Internet of Things (IoT) and machine learning techniques. The accuracy of species identification reaches about 100% for 200 rounds of random testing. Additionally, the HIDP can recognize animal species and their corresponding frequencies by analyzing sound characteristics, displaying real-time results with an accuracy of approximately 99% and 93%, respectively. In sum, this study offers a rational route to designing intelligent display devices for audiovisual interaction, which can expedite the application of smart display devices in human–machine interaction, soft robotics, wearable sound-vision system and medical devices for hearing-impaired patients.

    Tools

    Get Citation

    Copy Citation Text

    Yang Wang, Wenli Gao, Shuo Yang, Qiaolin Chen, Chao Ye, Hao Wang, Qiang Zhang, Jing Ren, Zhijun Ning, Xin Chen, Zhengzhong Shao, Jian Li, Yifan Liu, Shengjie Ling. Humanoid Intelligent Display Platform for Audiovisual Interaction and Sound Identification[J]. Nano-Micro Letters, 2023, 15(1): 221

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Research Articles

    Received: May. 9, 2023

    Accepted: Aug. 28, 2023

    Published Online: Dec. 15, 2023

    The Author Email: Ling Shengjie (lingshj@shanghaitech.edu.cn)

    DOI:10.1007/s40820-023-01199-y

    Topics