Aiming at the problems of multi-target tracking in video sequence, a multi-target tracking algorithm based on mean-shift and particle filter is proposed, which resolves the problem of target shielding by adopting the distance threshold and similar degree threshold among the targets in combination with Mean-shift algorithm and particle filter tracking algorithm. Experiment results show that the multi-target tracking algorithm can reduce the tracking time while ensuring the effects of tracking multi-target, so that the capability of the designed tracking system is improved .