In recent years, the field of civilian unmanned aerial vehicles has developed rapidly, leading to the frequent occurrence of unmanned aerial vehicle "black flying" incidents, which has brought considerable challenges to national security and social stability, and there is an urgent need to develop anti-UAV technology. In this regard, this paper proposes a follow-type directional jamming method and designs a vision-based UAV intrusion detection and automatic tracking and interception system. The HOG+nonlinear SVM scheme is used to identify the UAV, the ViBe moving target detection algorithm is added to improve the recognition speed, and UAV target tracking is realized through the KCF algorithm. Design and manufacture the hardware equipment of the UAV interception system, mainly including the tracking servo system, base and tray. Experiments show that the recognition accuracy of the system reaches 90.54%, the recognition speed is 20.56 fps, the interception platform can achieve the aim of the target UAV within 0.5 s, and the tracking effect is good. The system is tested on the built physical platform, and the results show that the system can realize the movement detection, recognition, tracking and interference of invading UAVs. The recognition accuracy is high, the real-time performance is good, and the system can automatically intercept the invading UAVs.