With the wide application of Unmanned Aerial Vehicles (UAVs), using UAVs for detecting and tracking the ground targets has become a research hotspot. Aiming at the problem of false detection and loss of target during the detection and tracking of moving objects by the optical flow method, the target detection is performed by using the longitudinal edge features of the moving object in conjunction with the optical flow method.Simultaneously, Scale-Invariant Feature Transform (SIFT) and optical flow method are used to realize target tracking. A method of matching the constant-speed model with the optical flow block is proposed to solve the problem of occlusion of the target by buildings during tracking.The experimental results show that the method can implement effective target identification and tracking, and has strong robustness.