Acta Optica Sinica, Volume. 40, Issue 5, 0510001(2020)

Facial Image Translation in Short-Wavelength Infrared and Visible Light Based on Generative Adversarial Network

Linmiao Hu1,2,3 and Yong Zhang1,3、*
Author Affiliations
  • 1Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China
  • 2University of Chinese Academy of Sciences, Beijing 100049, China
  • 3Key Laboratory of Infrared System Detection and Imaging Technology, Chinese Academy of Sciences, Shanghai 200083, China
  • show less

    We proposed an improved CycleGAN framework for translating short-wavelength infrared facial images and visible-light facial images. Based on the CycleGAN framework, a loss function calculation path was added and a new loss function was designed. A dataset was established, and the model parameters were adjusted based on experiments to improve the translation effect of the proposed model on the facial images. It effectively overcame the differences in images caused by different spectral characteristics so that the images could be easily recognized. The experimental verification was performed with a self-built dataset. The subjective evaluation, FID(Fréchet inception distance), and recognition accuracy were used to compare the proposed framework with several other frameworks. The results show that the improvement of the proposed framework is obvious and the structural features of the original target are better maintained, which effectively improves the observability and recognition accuracy of image translation results.

    Tools

    Get Citation

    Copy Citation Text

    Linmiao Hu, Yong Zhang. Facial Image Translation in Short-Wavelength Infrared and Visible Light Based on Generative Adversarial Network[J]. Acta Optica Sinica, 2020, 40(5): 0510001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Sep. 23, 2019

    Accepted: Nov. 9, 2019

    Published Online: Mar. 10, 2020

    The Author Email: Zhang Yong (zybxy@sina.com)

    DOI:10.3788/AOS202040.0510001

    Topics