Optical Technique, Volume. 49, Issue 3, 371(2023)

Colorization algorithm for Near Infrared images based on dual branching structure of color prediction and semantic perception

ZHAO Weiqiang*, WANG Yang, ZHU Yong, GAO Meiling, and DUAN Jin
Author Affiliations
  • [in Chinese]
  • show less
    References(24)

    [1] [1] Wu G M, Zheng Y Q, Guo Z L, et al. Learn to recover visible color for video surveillance in a day[C]∥Proceedings of the European Conference on Computer Vision (ECCV). Glasgow,UK:ECCV,2020:495-511.

    [2] [2] Fang H, Xia M, Zhou G, et al. Infrared small UAV target detection based on residual image prediction via global and local dilated residual networks[J]. IEEE Geoscience and Remote Sensing Letters,2022,19:1-5.

    [3] [3] Hunt E R, Hively W D, Fujikawa S J, et al. Acquisition of NIR-green-blue digital photographs from unmanned aircraft for crop monitoring[J]. Remote Sensing,2010,2(1):290-305.

    [4] [4] Levin A, Lischinski D, Weiss Y. Colorization using optimization[J]. ACM Transactions on Graphics,2004,23(3):689-694.

    [5] [5] Huang Y C, Tung Y S, Chen J C, et al. An adaptive edge detection based colorization algorithm and its applications[C]∥ Proceedings of the 13th annual ACM international conference on Multimedia. New York,USA:ACM,2005:351-354.

    [6] [6] Luan Q, Wen F, Cohen-Or D, et al. Natural image colorization[J]. Rendering Techniques,2007,7:309-320.

    [7] [7] Welsh T, Ashikhmin M, Mueller K. Transferring color to greyscale images[J]. ACM Transactions on Graphics,2002,21(3):277-280.

    [8] [8] Charpiat G, Hofmann M, Sch?lkopf B. Automatic image colorization via multimodal predictions[C]∥Proceedings of the European Conference on Computer Vision (ECCV). Marseille, France:Springer Berlin Heidelberg,2008:126-139.

    [9] [9] Cheng Z Z, Yang Q X, Sheng B. Deep colorization[C]∥ IEEE International Conference on Computer Vision (ICCV). Santiago,Chile:IEEE,2015:415-423.

    [10] [10] Iizuka S, Simo-Serra E, Ishikawa H. Let there be color!: Joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification[J]. ACM Transactions on Graphics,2016,35(4):1-11.

    [11] [11] Zhao J J, Liu L, Snoek C G M, et al. Pixel-level semantics guided image colorization[C]∥British Machine Vision Conference(BMVC). Newcastle, UK: British Machine Vision Association,2018:156.

    [12] [12] Zhao J J, Han J, Shao Ling, et al. Pixelated semantic colorization[J]. International Journal of Computer Vision,2020,128:818-834.

    [13] [13] Goodfellow I J, Pouget-Abadie J, Mirza M, et al. Generative adversarial nets[J]. Advances in Neural Information Processing Systems,2014,3:2672-2680.

    [14] [14] Zhu J Y, Park T, Isola P, et al. Unpaired Image-to-Image translation using Cycle-Consistent adversarial networks[C]∥IEEE International Conference on Computer Vision(ICCV). Venice,Italy:IEEE,2017:2223-2232.

    [15] [15] Liang W, Ding D, Wei G. An improved DualGAN for Near-infrared image colorization[J]. Infrared Physics & Technology,2021:103764.

    [16] [16] Su J W, Chu H K, Huang J B. Instance-aware image colorization[C]∥ IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Seattle, WA, USA:IEEE,2020:7965-7974.

    [18] [18] Kong G Q, Tian H, Duan X, et al. Adversarial Edge-aware image colorization with semantic segmentation[J]. IEEE Access,2021,9:28194-28203.

    [19] [19] Nguyen-Quynh T T, Kim S H, Do N T. Image colorization using the global Scene-context style and Pixel-wise semantic segmentation[J]. IEEE Access,2020,8:214098-214114.

    [20] [20] Ding L, Zhang H, Xiao J, et al. A lane detection method based on semantic segmentation[J]. Computer Modeling In Engineering & Sciences,2020,122(3):1039-1053.

    [22] [22] Zhao H, Shi J, Qi X, et al. Pyramid scene parsing network[C]∥ IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Honolulu,HI,USA:IEEE,2017:2881-2890.

    [23] [23] Brown M, Süsstrunk S. Multi-spectral sift for scene category recognition[C]∥IEEE Conference on Computer Vision and Pattern Recognition (CVPR).CO,USA:IEEE,2011:177-184.

    [24] [24] Isola P, Zhu J Y, Zhou T, et al. Image-to-image translation with conditional adversarial networks[C]∥ IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Honolulu,USA:IEEE,2017:1125-1134.

    [25] [25] Yi Z, Zhang H, Tan P, et al. DualGAN: Unsupervised dual learning for image-to-image translation[C]∥ Proceedings of the IEEE International Conference on Computer Vision(ICCV). Venice,Italy:IEEE,2017:2849-2857.

    [26] [26] Richard Z, Phillip I, Alexei A E, et al. The unreasonable effectiveness of deep features as a perceptual metric[C]∥ IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).UT,USA:IEEE,2018:586-595.

    Tools

    Get Citation

    Copy Citation Text

    ZHAO Weiqiang, WANG Yang, ZHU Yong, GAO Meiling, DUAN Jin. Colorization algorithm for Near Infrared images based on dual branching structure of color prediction and semantic perception[J]. Optical Technique, 2023, 49(3): 371

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Oct. 26, 2022

    Accepted: --

    Published Online: Nov. 26, 2023

    The Author Email: Weiqiang ZHAO (2904706840@qq.com)

    DOI:

    CSTR:32186.14.

    Topics