Color inconsistency is an urgent problem to be solved in free viewpoint television. In this letter, a new color correction method is proposed by using disparity vector information. At first, we separate foreground and background from the scene with a method of mean-removed disparity estimation. Then the correction parameters are estimated by adopting linear fitting for foreground and background regions, respectively. Next, with expectation-maximization algorithm, we integrate correction parameters of foreground and background to get the final corrected image. Finally, video tracking technique is performed to correct multi-view video. Experimental results show that the proposed method is quite effective.