Based on the Wang Tiles texture synthesis algorithm, the effects of texture gradient structure information, texture blocks with adaptive size, and Tile set generation method on the texture synthesis quality and time are studied. The color error and gradient information of the texture blocks are both used as the standard to measure the similarity of two blocks in the texture synthesis algorithm. It is better than the traditional texture synthesis algorithm, which only considers the color error to determine the similarity of two texture blocks. Meanwhile, using the optimized block size for texture synthesis, the texture synthesis time is reduced. In addition, using the improved Tile set to achieve texture synthesis, we can achieve better results than those of the traditional methods. Experimental results show that this algorithm can improve both the quality and the speed of texture synthesis, compared with the traditional Wang Tile-based algorithm.