Chinese Optics, Volume. 15, Issue 6, 1350(2022)

Image photoplethysmography for mental stress detection

Zhi RAO1, Bing-lin LI1, Ya-ru SUI1, Xiao-qiang JI1、*, and Ming-ye LI2,3
Author Affiliations
  • 1School of Life Science and Technology, Changchun University of Science and Technology, Changchun 130022, China
  • 2Department of Information Systems and Business Analytics, RMIT University, Melbourne 3001, Australia
  • 3School of Computing and Information Systems, The University of Melbourne, Melbourne 3053, Australia
  • show less

    To achieve non-contact daily mental stress detection, this paper proposes a image photoplethysmography to detect mental stress. First, a video of the subject's face is recorded by the cell phone camera. Then, the proposed Dynamic Region of Interest (ROI) extraction method based on Face Mesh is used to obtain the weak skin color changes caused by heart rate fluctuations. Next, the Fast Independent Component Analysis (FastICA) algorithm, wavelet transform and narrowband bandpass filtering are combined to extract the signal and heart rate variability information based on image photoplethysmography. Then, stress-induced experiments are conducted on 30 subjects to screen 14 features for mental stress detection by comparing the differences in heart rate variability parameters between normal and stressful states, and to explore the relationship between short-term mental stress and daily mental stress due to stress induction. Finally, an additional 67 subjects are tested for daily mental stress, and a triple classifier for mental stress detection is built using the machine learning algorithm. The experimental results show that the accuracy of the three classifications of mental stress can reach 95.2%. Given that this method does not require long-term measurements and can accurately detect human mental stress levels using only a smartphone, and that the measurement method is simple, and easy to administer, and does not affect the normal psychological and mental state of the subject, it can be used as a valid tool in psychological research.

    Tools

    Get Citation

    Copy Citation Text

    Zhi RAO, Bing-lin LI, Ya-ru SUI, Xiao-qiang JI, Ming-ye LI. Image photoplethysmography for mental stress detection[J]. Chinese Optics, 2022, 15(6): 1350

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Original Article

    Received: Aug. 10, 2022

    Accepted: --

    Published Online: Feb. 9, 2023

    The Author Email:

    DOI:10.37188/CO.2022-0180

    Topics