Acta Optica Sinica, Volume. 40, Issue 5, 0510001(2020)

Facial Image Translation in Short-Wavelength Infrared and Visible Light Based on Generative Adversarial Network

Linmiao Hu1,2,3 and Yong Zhang1,3、*
Author Affiliations
  • 1Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China
  • 2University of Chinese Academy of Sciences, Beijing 100049, China
  • 3Key Laboratory of Infrared System Detection and Imaging Technology, Chinese Academy of Sciences, Shanghai 200083, China
  • show less
    References(35)

    [1] Dutta A K. Imaging beyond human vision. [C]//8th International Conference on Electrical and Computer Engineering, December 20-22, 2014, Dhaka, Bangladesh. New York: IEEE, 224-229(2014).

    [2] Cao Z C, Schmid N A, Bourlai T. Composite multilobe descriptors for cross-spectral recognition of full and partial face[J]. Optical Engineering, 55, 083107(2016).

    [4] Kalka N D, Bourlai T, Cukic B et al. Cross-spectral face recognition in heterogeneous environments: a case study on matching visible to short-wave infrared imagery. [C]//2011 International Joint Conference on Biometrics (IJCB), October 11-13, 2011, Washington, DC, USA. New York: IEEE, 12494407(2011).

    [5] Hu S W, Short N, Riggan B S et al. Heterogeneous face recognition: recent advances in infrared-to-visible matching. [C]//2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), May 30-June 3, 2017, Washington, DC, USA. New York: IEEE, 883-890(2017).

    [7] Zhang R, Isola P, Efros A A. Colorful image colorization[M]. //Leibe B, Matas J, Sebe N, et al. Computer vision-ECCV 2016. Lecture notes in computer science. Cham: Springer, 9907, 649-666(2016).

    [8] Pathak D, Krahenbuhl P, Donahue J et al. Context encoders: feature learning by inpainting. [C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 2536-2544(2016).

    [9] Gatys L A, Ecker A S, Bethge M. Image style transfer using convolutional neural networks. [C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 2414-2423(2016).

    [10] Laffont P Y, Ren Z L, Tao X F et al. Transient attributes for high-level understanding and editing of outdoor scenes[J]. ACM Transactions on Graphics, 33, 149(2014).

    [11] Wu H M, Liu Q R, Wang Y H. Face image translation based on generative adversarial networks[J]. Journal of Tianjin University(Science and Technology), 52, 306-314(2019).

    [12] Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. [C]//2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 3431-3440(2015).

    [14] Huang X, Liu M Y, Belongie S et al. Multimodal unsupervised image-to-image translation[M]. //Ferrari V, Hebert M, Sminchisescu C, et al. Computer vision-ECCV 2018. Lecture notes in computer science. Cham: Springer, 11207, 179-196(2018).

    [15] Goodfellow I, Pouget-Abadie J, Mirza M et al. Generative adversarial nets. [C]//Advances in Neural Information Processing Systems, December 8-13, 2014, Montreal, Quebec, Canada. New York: Curran Associates, 2672-2680(2014).

    [18] Isola P, Zhu J Y, Zhou T H et al. Image-to-image translation with conditional adversarial networks. [C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 5967-5976(2017).

    [19] Ronneberger O, Fischer P, Brox T. U-net: convolutional networks for biomedical image segmentation[M]. //Navab N, Hornegger J, Wells W, et al. Medical image computing and computer-assisted intervention-MICCAI 2015. Lecture notes in computer science. Cham: Springer, 9351, 234-241(2015).

    [20] Zhu J Y, Park T, Isola P et al. Unpaired image-to-image translation using cycle-consistent adversarial networks. [C]//2017 IEEE International Conference on Computer Vision (ICCV), October 22-29, 2017, Venice, Italy. New York: IEEE, 2242-2251(2017).

    [21] Yi Z L, Zhang H, Tan P et al. DualGAN: unsupervised dual learning for image-to-image translation. [C]//2017 IEEE International Conference on Computer Vision (ICCV), October 22-29, 2017, Venice, Italy. New York: IEEE, 2868-2876(2017).

    [22] Kim T, Cha M, Kim H et al. Learning to discover cross-domain relations with generative adversarial networks[J]. Proceedings of the 34th International Conference on Machine Learning, 70, 1857-1865(2017).

    [23] Liu M Y, Breuel T, Kautz J. Unsupervised image-to-image translation networks. [C]//Advances in Neural Information Processing Systems, December 4-9, 2017, Long Beach, CA, USA. New York: Curran Associates, 700-708(2017).

    [24] Lee H Y, Tseng H Y, Huang J B et al. Diverse image-to-image translation via disentangled representations[M]. //Ferrari V, Hebert M, Sminchisescu C, et al. Computer vision-ECCV 2018. Lecture notes in computer science. Cham: Springer, 11205, 36-52(2018).

    [27] Song L, Zhang M, Wu X et al. Adversarial discriminative heterogeneous face recognition. [C]//Thirty-Second AAAI Conference on Artificial Intelligence, February 2-7, 2018, New Orleans, Louisiana, USA. Menlo Park: AAAI, 7355-7362(2018).

    [28] Wang Z L, Chen Z Z, Wu F. Thermal to visible facial image translation using generative adversarial networks[J]. IEEE Signal Processing Letters, 25, 1161-1165(2018).

    [29] Riggan B S, Short N J, Hu S W. Thermal to visible synthesis of face images using multiple regions. [C]//2018 IEEE Winter Conference on Applications of Computer Vision (WACV), March 12-15, 2018, Lake Tahoe, NV, USA. New York: IEEE, 30-38(2018).

    [30] Zhang T, Wiliem A, Yang S Q et al. TV-GAN: generative adversarial network based thermal to visible face recognition. [C]//2018 International Conference on Biometrics (ICB), February 20-23, 2018, Gold Coast, QLD, Australia. New York: IEEE, 174-181(2018).

    [31] Lezama J, Qiu Q, Sapiro G. Not afraid of the dark: NIR-VIS face recognition via cross-spectral hallucination and low-rank embedding. [C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 6807-6816(2017).

    [32] Ghiass R S. Arandjelovi O, Bendada H, et al. Infrared face recognition: a literature review. [C]//The 2013 International Joint Conference on Neural Networks (IJCNN), August 4-9, 2013, Dallas, TX, USA. New York: IEEE, 14027413(2013).

    [33] Sun L, Zheng Z W. Thermal-to-visible face alignment on edge map[J]. IEEE Access, 5, 11215-11227(2017).

    [34] Heusel M, Ramsauer H, Unterthiner T et al. GANs trained by a two time-scale update rule converge to a local Nash equilibrium. [C]//Advances in Neural Information Processing Systems, December 4-9, 2017, Long Beach, CA, USA. New York: Curran Associates, 6626-6637(2017).

    [35] Schroff F, Kalenichenko D, Philbin J. FaceNet: a unified embedding for face recognition and clustering. [C]//2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 815-823(2015).

    Tools

    Get Citation

    Copy Citation Text

    Linmiao Hu, Yong Zhang. Facial Image Translation in Short-Wavelength Infrared and Visible Light Based on Generative Adversarial Network[J]. Acta Optica Sinica, 2020, 40(5): 0510001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Sep. 23, 2019

    Accepted: Nov. 9, 2019

    Published Online: Mar. 10, 2020

    The Author Email: Zhang Yong (zybxy@sina.com)

    DOI:10.3788/AOS202040.0510001

    Topics