Journal of Applied Optics, Volume. 45, Issue 3, 616(2024)

Low-light pedestrian detection and tracking algorithm based on autoencoder structure and improved Bytetrack

Zelin REN... Lan PANG, Chao WANG, Jiaheng LI and Fangyan ZHOU* |Show fewer author(s)
Author Affiliations
  • Xi'an Institute of Applied Optics, Xi'an 710065, China
  • show less

    Aiming at the problems of difficult target feature extraction and unstable tracking in low-light scenes at night, a multi-target pedestrian detection and tracking algorithm based on the autoencoder structure and improved Bytetrack was proposed. In the detection phase, a multi-task auto-encoding transformation model framework based on you only look once X (YOLOX) was built, considering the physical noise model and image signal processing (ISP) process in a self-supervised manner, learning the intrinsic features by encoding and decoding the real illumination degradation transformation process, and realizing the object detection tasks by decoding bounding box coordinates and classes based on this representation. In order to suppress the interference of background noise, the adaptive feature fusion module ASFF was introduced in the target decoder neck network. In the tracking phase, it was improved by Bytetrack algorithm, and the appearance embedded information extracted based on the Transformer re-identification network as well as the motion information obtained by the NSA Kalman filter was used to complete the data association through an adaptive weighting method, and the Byte twice matching algorithm was used to complete the tracking of pedestrian at night. The generalization ability of the detection model was tested on the self-built night pedestrian detection data set, and the mAP@0.5 reached 94.9%. The results showed that the proposed degradation transformation process met the realistic conditions and had good generalization ability. Finally, the multi-target tracking performance was verified through the night pedestrian tracking data set. The experimental results show that the proposed multiple object tracking accuracy (MOTA) of the night low-light pedestrian multi-target tracking algorithm is 89.55%, the identity F1 score (IDF1) is 88.34%, and the ID switches (IDs) are 15. Compared with the baseline method Bytetrack, the MOTA is improved by 10.72%, the IDF1 is improved by 6.19%, and the IDs are reduced by 50%. The results show that the proposed multi-target tracking algorithm based on the autoencoding structure and improved Bytetrack can effectively solve the problem of difficult pedestrian tracking in low-light scenes at night.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Zelin REN, Lan PANG, Chao WANG, Jiaheng LI, Fangyan ZHOU. Low-light pedestrian detection and tracking algorithm based on autoencoder structure and improved Bytetrack[J]. Journal of Applied Optics, 2024, 45(3): 616

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Research Articles

    Received: Oct. 27, 2023

    Accepted: --

    Published Online: Jun. 2, 2024

    The Author Email: ZHOU Fangyan (周方琰(1998—))

    DOI:10.5768/JAO202445.0302001

    Topics