Laser & Optoelectronics Progress, Volume. 61, Issue 22, 2215005(2024)

Fatigue Driving Detection Under Low Illumination Using Image Enhancement and Facial State Recognition

Yang Zhao1,2, Jialong Miao1、*, Xuefeng Liu1, Jincheng Zhao3, and Sen Xu1,2
Author Affiliations
  • 1The College of Computer Science and Technology, Shenyang University of Chemical Technology, Shenyang 110142, Liaoning , China
  • 2Key Laboratory of Intelligent Technology for Chemical Process Industry of Liaoning Province, Shenyang 110142, Liaoning , China
  • 3The College of Information Engineering, Shenyang University of Chemical Technology, Shenyang 110142, Liaoning , China
  • show less

    This study proposes a fatigue driving detection model based on image enhancement and facial state recognition to address the issues of low accuracy, large model size, and reduced performance in low-light environments found in existing models. The YOLOv5s model was enhanced for face detection and key point localization under low illumination, incorporating a self-calibrated illumination module to enhance low-illumination images. The downsampling layer was replaced with the StemBlock module to improve feature expression capability, and the backbone network was replaced with ShuffleNetv2 to reduce the model's parameters and computational complexity. Replacing the C3 module with the cbam inverted bottleneck C3 (CIBC3) reduced noise interference in detection and enhanced the model's global perception ability. Furthermore, the wing loss function was added to the total loss function for facial keypoint regression. A fatigue state recognition network was employed to determine the opening and closing statuses of the eyes and mouth located by the face detection model, and evaluation indicators were used to determine the fatigue state. The experimental results obtained on the DARK FACE dataset demonstrate that, compared to the benchmark YOLOv5s model, the improved model reduced parameters and computational complexity by 62.12% and 63.41%, respectively, and improved accuracy by 2.38 percentage points. The proposed fatigue driving detection model achieved accuracies of 96.07% and 94.50% on the YawDD normal lighting and self-built low-lighting datasets, respectively, outperforming other models. The processing time per image was only 27 ms, demonstrating that the proposed model not only ensures detection accuracy in normal and low-light environments but also meets real-time requirements, making it suitable for deployment on edge computing equipment with limited computing power.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Yang Zhao, Jialong Miao, Xuefeng Liu, Jincheng Zhao, Sen Xu. Fatigue Driving Detection Under Low Illumination Using Image Enhancement and Facial State Recognition[J]. Laser & Optoelectronics Progress, 2024, 61(22): 2215005

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Feb. 20, 2024

    Accepted: Mar. 25, 2024

    Published Online: Nov. 19, 2024

    The Author Email: Jialong Miao (igxiaodingdang@163.com)

    DOI:10.3788/LOP240711

    CSTR:32186.14.LOP240711

    Topics