In order to obtain steady image sequence from unsteady camera and to realize object tracking based on image stabilization,a separating method of active scanning movement from random jitter of camera are presented. Mean Shift with Particle Filter (MSPF) algorithm is proposed to realize motion separation. This algorithm uses particle filter to forecast particles, and then move them to be close to the real position of object through single mean shift iteration,which can undermine the dependence of the calculation accuracy on the number of particles. To a complex background in reality,the MSPF algorithm can be used to separate active scanning movement from random jitter of camera, and then image difference and motion compensation can be used to detect moving object to realize the stability of image tracking. Experimental results show that the MSPF algorithm with 50% particles can achieve the same effect with traditional particle filter,which means proposed algorithm can shortens process time and can realize real-time image stabilization for vehicle-borne, ship-borne, air-borne and other stable tracking systems.