The target tracking algorithm in compression domain based on compression perception is studied. To meet the specific application requirements, the shortcomings of original algorithm are improved. At the same time, based on the design idea and demand of miniaturized target position detector, a real-time image pro-cessing platform with TMS320DM6437 digital signal processor as the core is designed and implemented, and the algorithm is implemented and optimized on the DSP platform. The simulation and experiment results show that after the combination of Kalman filter, LBP feature and adding adaptive learning rate update strategy, the stability of the algorithm is improved. For the implementation in DSP, after a series of optimizing measures, as for an image with resolution of 960×960, taking the target window of 80×80 into account, the computation speed can be up to 25 fps, which can meet the requirement of real-time tracking. The embedded tracking system can track the selected moving objects continuously and stably, and can meet the target localization and tracking require-ments under specific applications, which has a real practical value. Moreover, the method in this paper has a certain reference value for the research and applications of this kind of target tracking method in the embedded platform.