Based on image quilting texture transfer algorithm, we study the effects of texture gradient structure information and brightness error between source texture image and target image on texture transmission. When selecting the candidate texture block, we take both the gradient structure information and color error of the texture block as the criterion. Meanwhile, we remap the brightness of the source texture image to the same level as the brightness of the target image, which can avoid the case where the optimal block cannot be selected due to the too large brightness error. The experimental results show that compared with the traditional texture transfer algorithm, the improved algorithm can achieve a better transmission effect.