Optics and Precision Engineering, Volume. 30, Issue 3, 320(2022)

Infrared and visible image fusion based on WEMD and generative adversarial network reconstruction

Yanchun YANG*, Xiaoyu GAO, Jianwu DANG, and Yangping WANG
Author Affiliations
  • School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou730070, China
  • show less
    References(25)

    [1] [1] 1刘先红, 陈志斌, 秦梦泽. 结合引导滤波和卷积稀疏表示的红外与可见光图像融合[J]. 光学 精密工程, 2018, 26(5): 1242-1253. doi: 10.3788/OPE.20182605.1242LIUX H, CHENZH B, QINM Z. Infrared and visible image fusion using guided filter and convolutional sparse representation[J]. Optics and Precision Engineering, 2018, 26(5): 1242-1253. (in Chinese). doi: 10.3788/OPE.20182605.1242

    [2] SINGH R, VATSA M, NOORE A. Integrated multilevel image fusion and match score fusion of visible and infrared face images for robust face recognition[J]. Pattern Recognition, 41, 880-893(2008).

    [3] HAN J, BHANU B. Fusion of color and infrared video for moving human detection[J]. Pattern Recognition, 40, 1771-1784(2007).

    [4] REINHARD E, ADHIKHMIN M, GOOCH B et al. Color transfer between images[J]. IEEE Computer Graphics and Applications, 21, 34-41(2001).

    [5] [5] 5冯维, 吴贵铭, 赵大兴, 等. 多图像融合Retinex用于弱光图像增强[J]. 光学 精密工程, 2020, 28(3): 736-744. doi: 10.3788/ope.20202803.0736FENGW, WUG M, ZHAOD X, et al. Multi images fusion Retinex for low light image enhancement[J]. Optics and Precision Engineering, 2020, 28(3): 736-744. (in Chinese). doi: 10.3788/ope.20202803.0736

    [6] [6] 6殷明, 段普宏, 褚标, 等. 基于非下采样双树复轮廓波变换和稀疏表示的红外和可见光图像融合[J]. 光学 精密工程, 2016, 24(7): 1763-1771. doi: 10.3788/OPE.20162407.1763YINM, DUANP H, CHUB, et al. Fusion of infrared and visible images combined with NSDTCT and sparse representation[J]. Optics and Precision Engineering, 2016, 24(7): 1763-1771. (in Chinese). doi: 10.3788/OPE.20162407.1763

    [7] RIAZ M M, GHAFOOR A. Fuzzy logic and additive wavelet-based panchromatic sharpening[J]. IEEE Geoscience and Remote Sensing Letters, 11, 357-360(2014).

    [8] CHEN G, LI L, JIN W Q et al. Weighted sparse representation and gradient domain guided filter pyramid image fusion based on low-light-level dual-channel camera[J]. IEEE Photonics Journal, 11, 1-15(2019).

    [9] CHOI M, KIM R Y et al. Fusion of multispectral and panchromatic Satellite images using the curvelet transform[J]. IEEE Geoscience and Remote Sensing Letters, 2, 136-140(2005).

    [10] HUANG N E, SHEN Z, LONG S R et al. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis[J]. Proceedings of the Royal Society of London Series A: Mathematical, Physical and Engineering Sciences, 454, 903-995(1998).

    [11] YANG J K, GUO L, YU S W et al. A new multi-focus image fusion algorithm based on BEMD and improved local energy[J]. Journal of Software, 9, 2329-2334(2014).

    [12] [12] 12王慧斌, 廖艳, 沈洁, 等. 分级多尺度变换的水下偏振图像融合法[J]. 光子学报, 2014, 43(5): 192-198. doi: 10.3788/gzxb20144305.0510004WANGH B, LIAOY, SHENJ, et al. Method of underwater polarization image fusion based on hierarchical and multi-scale transform[J]. Acta Photonica Sinica, 2014, 43(5): 192-198. (in Chinese). doi: 10.3788/gzxb20144305.0510004

    [13] LI H, WU X J, KITTLER J. Infrared and visible image fusion using a deep learning framework[C], 2705-2710(2018).

    [14] MA J Y, YU W, LIANG P W et al. FusionGAN: a generative adversarial network for infrared and visible image fusion[J]. Information Fusion, 48, 11-26(2019).

    [15] [15] 15朱攀, 黄战华. 基于二维经验模态分解和高斯模糊逻辑的红外与可见光图像融合[J]. 光电子·激光, 2017, 28(10): 1156-1162. doi: 10.1016/j.infrared.2017.01.013ZHUP, HUANGZH H. Fusion of infrared and visible images based on BEMD and GFL[J]. Journal of Optoelectronics·Laser, 2017, 28(10): 1156-1162. (in Chinese). doi: 10.1016/j.infrared.2017.01.013

    [16] RADFORD A, METZ L, CHINTALA S. Unsupervised representation learning with deep convolutional generative adversarial networks[J]. ICLR 2016(2015).

    [17] LIU Y, WANG Z F. Simultaneous image fusion and denoising with adaptive sparse representation[J]. IET Image Processing, 9, 347-357(2015).

    [18] ZHANG Y, ZHANG L J, BAI X Z et al. Infrared and visual image fusion through infrared feature extraction and visual information preservation[J]. Infrared Physics & Technology, 83, 227-237(2017).

    [19] LIU Y, CHEN X, WARD R K et al. Medical image fusion via convolutional sparsity based morphological component analysis[J]. IEEE Signal Processing Letters, 26, 485-489(2019).

    [20] AMIN-NAJI M, AGHAGOLZADEH A, EZOJI M. Ensemble of CNN for multi-focus image fusion[J]. Information Fusion, 51, 201-214(2019).

    [21] SHEN Y, WU Z D, WANG X P et al. Tetrolet transform images fusion algorithm based on fuzzy operator[J]. Journal of Frontiers of Computer Science and Technology, 9, 1132-1138(2015).

    [22] XYDEAS C S, PETROVIĆ V. Objective image fusion performance measure[J]. Electronics Letters, 36, 308(2000).

    [23] [23] 23闫莉萍, 刘宝生, 周东华. 一种新的图像融合及性能评价方法[J]. 系统工程与电子技术, 2007, 29(4): 509-513. doi: 10.3321/j.issn:1001-506X.2007.04.003YANL P, LIUB SH, ZHOUD H. Novel image fusion algorithm with novel performance evaluation method[J]. Systems Engineering and Electronics, 2007, 29(4): 509-513. (in Chinese). doi: 10.3321/j.issn:1001-506X.2007.04.003

    [24] MA J Y, MA Y, LI C. Infrared and visible image fusion methods and applications: a survey[J]. Information Fusion, 45, 153-178(2019).

    [25] QU G H, ZHANG D L, YAN P F. Information measure for performance of image fusion[J]. Electronics Letters, 38, 313-315(2002).

    CLP Journals

    [1] Yongxing ZHANG, Bowen LIAN, Naiting GU, Fangzhao LI, Yang LI. Infrared and visible image fusion based on multi-scale spatial attention complementary[J]. Optics and Precision Engineering, 2025, 33(7): 1152

    [2] Yongxing ZHANG, Bowen LIAN, Naiting GU, Fangzhao LI, Yang LI. Infrared and visible image fusion based on multi-scale spatial attention complementary[J]. Optics and Precision Engineering, 2025, 33(7): 1152

    Tools

    Get Citation

    Copy Citation Text

    Yanchun YANG, Xiaoyu GAO, Jianwu DANG, Yangping WANG. Infrared and visible image fusion based on WEMD and generative adversarial network reconstruction[J]. Optics and Precision Engineering, 2022, 30(3): 320

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Information Sciences

    Received: May. 27, 2021

    Accepted: --

    Published Online: Mar. 4, 2022

    The Author Email: Yanchun YANG (yangyanchun102@sina.com)

    DOI:10.37188/OPE.20223003.0320

    Topics