To cope with the occlusion and intersection between targets and the environment, location prediction is employed in the visual tracking system. Target trace is fitted by sliding subsection polynomials based on least absolute deviation (LAD) estimation, and the future location of target is predicted with the fitted trace. Experiment results show that the proposed location prediction algorithm based on LAD estimation has significant robustness advantages over least square (LS) estimation, and it is more effective than LS-based methods in visual tracking.