A target tracking method is proposed based on local feature index structure,which introduces Bag of Visual Word(BoVW) into the tracking method.A target tracking method that does not rely on a specific feature type is constructed,which solves the calculation and measurement problems when using the feature descriptor to perform similarity measurement in actual applications.Then,the accuracy and robustness of tracking are improved by eliminating the mismatched features and the correlation prediction of unmatched features.Finally, the foreground features of the target area are separated and the target area is optimally updated to obtain more accurate tracking results.