Laser & Optoelectronics Progress, Volume. 59, Issue 4, 0415003(2022)

Unlabeled Video Retrieval Method of Mining Personnel Based on MK-YOLOV4

Yunhui Zhao1, Xiaozhou Cheng2, Kaiwen Dong1、*, Xiao Yun1, Yanjing Sun1, and Yingjie Han1
Author Affiliations
  • 1School of Information and Control Engineering, China University of Mining and Technology, Xuzhou , Jiangsu 221116, China
  • 2Sinosteel Maanshan Institute of Mining Research Co., Ltd., Maanshan, Anhui 243000, China
  • show less

    Precise positioning and accurate identification of personnel entering, exiting, and conducting important production activities in the mining area are important foundations for achieving intelligent and safe production in the mining area. This study proposes an unlabeled video retrieval method for personnel in the mining area using MK-YOLOV4 in the complex mining area production environment, which can realize multiperson target detection and reidentification of an individual's identity on unlabeled video of important gateway monitoring in the mining area. First, this study proposes the MK-YOLOV4 algorithm to achieve multiperson detection of unlabeled videos by building multiscale predictions on YOLOV4, and the K-means++ algorithm is combined to generate an anchor box that meets the characteristics of the samples, which can improve the representation learning of the convolutional neural network for small targets. Second, we propose a channel attention feature extraction network based on appearance invariance to achieve accurate reidentification of personnel in mining areas. Aiming at solving the problem of uniform work clothes for personnel in mining areas, this study proposes a weight-constrained difficult sample sampling loss function with two data enhancement strategies, where Color jitter and random erasure are combined to improve the accuracy and robustness of the identification network. Finally, according to the characteristics of the existing training dataset with few categories and single scene samples, a Miner-Market mining personnel reidentification dataset is constructed with the characteristics of the mining scenes, and the proposed method is verified on the standard dataset and Miner-Market dataset. The verification confirmed that the proposed method has high retrieval performance and recognition accuracy.

    Tools

    Get Citation

    Copy Citation Text

    Yunhui Zhao, Xiaozhou Cheng, Kaiwen Dong, Xiao Yun, Yanjing Sun, Yingjie Han. Unlabeled Video Retrieval Method of Mining Personnel Based on MK-YOLOV4[J]. Laser & Optoelectronics Progress, 2022, 59(4): 0415003

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Mar. 1, 2021

    Accepted: Apr. 2, 2021

    Published Online: Feb. 15, 2022

    The Author Email: Dong Kaiwen (dongkaiwen1996@outlook.com)

    DOI:10.3788/LOP202259.0415003

    Topics