Optics and Precision Engineering, Volume. 27, Issue 8, 1836(2019)
Image style transfer based on improved CycleGAN
Image style transfer exploits a specified style to modify given image content. An automatic image style transfer based on a Generative Adversarial Network (GAN) can reduce the workload and yield rich results. In some cases, the pair datasets required by the classical GAN were difficult to obtain. To overcome the limitations of paired datasets by a traditional GAN and improve the efficiency of style transfer, this study proposed an image style transfer method based on an improved Cycle-consistent adversarial network (CycleGAN). In this study, the deep residual network adopted by the conventional network generator was replaced by the dense connection convolution network, and a novel loss function composed of the same mapping and perceptual losses was used to measure the style transfer loss. These improvements were shown to increase the network performance, overcome the networks limitations on paired samples, and improve the quality of images generated by style migration. In addition, the stability was further improved and the network convergence speed was accelerated. Experiments demonstrate that the peak signal-to-noise ratio of the image generated by the proposed method increase 6.27% on average, where as the structural similarity index measure increased by approximately 10%. The improved CycleGAN image style transfer method proposed in this study can thus generate better style images.
Get Citation
Copy Citation Text
DU Zhen-long, SHEN Hai-yang, SONG Guo-mei, LI Xiao-li. Image style transfer based on improved CycleGAN[J]. Optics and Precision Engineering, 2019, 27(8): 1836
Category:
Received: Dec. 11, 2018
Accepted: --
Published Online: Jan. 19, 2020
The Author Email: Zhen-long DU (duzhl@njtech.edu.cn)