An online combined two kinds of features method for visual object tracking was proposed. A feature set was built by combining object contour’s linear parametric equation and edge histogram. Firstly, the Hough transform is used to detect line in picture and obtain the parameters of the line, meanwhile, get the histogram at the same position of the line. The resulting initial template contains the location and pixel distribution information of the target. Secondly, in the subsequent frames, pixels divided and clustered by gradient direction and parameter equation would form more than one line which was to be matched. At last, obtain the exact location of the straight edge using the histogram matching algorithm. The experimental results indicate that the algorithm can run effectively when occlusion and complicated backgrounds happened, and perform favorably on challenging sequences in terms of efficiency, accuracy and robustness.