Optics and Precision Engineering, Volume. 30, Issue 24, 3225(2022)

Fusion of infrared and visible images via structure and texture-aware retinex

Jianping HU1... Mengyun HAO1, Ying DU2, and Qi XIE13,* |Show fewer author(s)
Author Affiliations
  • 1School of Science, Northeast Electric Power University, Jilin3202, China
  • 2School of Data Science and Artificial Intelligence, Jilin Engineering Normal University, Changchun13005, China
  • 3School of Mathematics, Jilin University, Changchun10012, China
  • show less

    To improve the quality of the fusion of infrared and visible images, this study proposes a novel method based on structure and texture-aware Retinex (STAR). It first decomposes the source images into reflection and illumination components according to the STAR model. This decomposition can separate the texture and structure of the source images accurately and extract the detailed features of the visible images with low luminance. Subsequently, it merges the reflection component using a weight map, which is constructed using the second-order gradient of the source images as the input. Moreover, it merges the illumination component using a gamma function, which can make the fused image have more brightness information. Finally, it reconstructs the fused reflection and illumination components to obtain the final fusion image. According to the test on 38 pairs of widely used images in the TNO infrared and visible image database, the proposed method can generate excellent fused results with high visual quality. Furthermore, compared with five state-of-the-art methods for the fusion of infrared and visible images, the proposed method achieved significantly better objective evaluation results in mutual information, nonlinear correlation information entropy, and feature measurement based on image phase consistency. This study involves the use of STAR model for fusing infrared and visible images and establishes a direct fusion framework based on Retinex, which improves the fusion results of the existing methods in terms of detailed features and global contrast.

    Tools

    Get Citation

    Copy Citation Text

    Jianping HU, Mengyun HAO, Ying DU, Qi XIE. Fusion of infrared and visible images via structure and texture-aware retinex[J]. Optics and Precision Engineering, 2022, 30(24): 3225

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Information Sciences

    Received: May. 28, 2022

    Accepted: --

    Published Online: Feb. 15, 2023

    The Author Email: XIE Qi (xieqi_19820302@126.com)

    DOI:10.37188/OPE.20223024.3225

    Topics