Journal of Optoelectronics · Laser, Volume. 36, Issue 7, 712(2025)

Blue calico pattern generation based on improved stable diffusion model

WANG Zixiang1,2, JIA Xiaojun1,2、*, RAN Erfei3, and XU Congyuan2
Author Affiliations
  • 1School of Information Science and Engineering, Zhejiang Sci-Tech University, Hangzhou, Zhejiang 310018, China
  • 2College of Information Science and Engineering, Jiaxing University, Jiaxing, Zhejiang 314001, China
  • 3School of Computer Science and Technology (School of Artificial Intelligence), Zhejiang Sci-Tech University, Hangzhou, Zhejiang 310018, China
  • show less

    Aiming at the lack of digital inheritance and innovation technology of blue calico patterns of Chinese intangible cultural heritage, this paper proposes a method for generating blue calico patterns based on the improved stable diffusion (SD) model, which realizing the active generation of single and multiple blue calico patterns through text-to-image and image-to-image technology. For the problem that the blue calico pattern datasets is less and it is difficult to train a large model, a low-rank adaptation algorithm (LoRA) fine-tuning network with blue calico characteristics is trained by combining the stable diffusion model and the LoRA fine-tuning network. Aiming at the problem that the output of the stable diffusion model is random, the stable diffusion model is combined with the discriminative network to judge the generated images and filter out the texture images that are consistent with the characteristics of blue calico. The experimental results show that the new blue calico patterns with semantic information and picture characteristics can be generated by the key prompt words or pictures.

    Tools

    Get Citation

    Copy Citation Text

    WANG Zixiang, JIA Xiaojun, RAN Erfei, XU Congyuan. Blue calico pattern generation based on improved stable diffusion model[J]. Journal of Optoelectronics · Laser, 2025, 36(7): 712

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Mar. 27, 2024

    Accepted: Jun. 24, 2025

    Published Online: Jun. 24, 2025

    The Author Email: JIA Xiaojun (xjjiad@sina.com)

    DOI:10.16136/j.joel.2025.07.0145

    Topics