When background fluctuates in the image, the target tracking process will follow the fluctuation of background with corrected background-weighted histogram (CBWH) algorithm, which will cause fluctuation-errors. In order to improve the tracking effect under fluctuant background and reduce the fluctuation-errors, this paper proposes a background gradient corrected histogram (BGCH) algorithm based on CBWH algorithm. It uses the background gradient information of adjacent frames to perform a second-order correction on the target model, and blocks the fluctuation-following process of the CBWH algorithm in advance. Experimental results show that this method significantly reduces the fluctuation-errors of CBWH algorithm, and also shows better robustness under the condition of target deforming and blurring.