In addressing the challenges posed by the protracted nature of the process, its suboptimal efficiency, and the substantial labor costs incurred in the fabrication of shield segments, a novel automatic plastering robot hardware system has been conceptualized. In order to ensure the fulfillment of the quality inspection requirements for precast concrete following the initial plastering, a human-computer interaction software system has been developed. The system is founded on the YOLOv5 feature detection algorithm. The integration of the automatic plastering robot with the feature detection human-computer interface enables the automation of the shield segment production process. Empirical evidence demonstrates the efficacy of the YOLOv5 feature detection algorithm in accurately detecting defects in concrete surface features after initial plastering, while the robot exhibits high positioning precision. The system's comprehensive alignment with practical production demands ensures enhanced efficiency.