On the basis of SURF registration and history motion image building,a new algorithm for moving target detection based on image sequence was proposed.To deal with the problem of false alarm in motion detection,a multi-frame collision detection algorithm was put forward to eliminate the false moving target, which combining multi-frame association with collision detection theory.Simulation was made by using standard test sequences.The results show that the moving target detection algorithm has high recall ratio, high detection precision and very low false alarm probability.