Aimed at the defect of the traditional mean shift tracking algorithm by using symmetric kernel function, which contains amounts of background pixels, an enhanced mean shift tracking algorithm is presented based on active asymmetric kernel to improve the tracking accuracy and stability. The paper firstly described the calculation method of template center which is the key issue in introducing asymmetric kernel function into mean shift algorithm framework. Then, to combine the expression and evolution of asymmetric kernel function, level set contour evolution algorithm using regional similarity is presented. Finally, the asymmetric kernel function update strategy is introduced. The above three points constitute the mean shift tracking algorithm based on evolutive asymmetric kernel function overall context. Experimental results show that compared to existing methods, the mean shift tracking algorithm based on evolutive asymmetric kernel presented has higher accuracy and reliability, as well as meets the real-time requirements of general tracking tasks.