For the ghost in visual background extractor (ViBe) algorithm and the influence of dynamic background, an improved ViBe algorithm is proposed to extract moving object in this paper. The way of background acquisition during modeling is improved to eliminate the ghost. Detect the saliency of the pre-M-frame, and synthetic relatively real background. Modeling with the background can avoid the generation of ghost. The selection of thresholds in the model is improved to reduce the impact of the dynamic background. Adjust the thresholds adaptively according to the background com-plexity. In addition, find the inner contour of extracted object to fill, which makes the detected targets more complete. Experimental results show that the presented algorithm effectively removes ghosts and enhances anti-interference abil-ity. Compared with several existing methods, the presented algorithm has better performance.