Laser & Optoelectronics Progress, Volume. 60, Issue 24, 2410002(2023)

Infrared and Visible Image Fusion Based on Separate Expression of Mutual Information Features

Hui Wang1,2,3, Xiaoqing Luo1,2,3、*, and Zhancheng Zhang4
Author Affiliations
  • 1School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi 214122, Jiangsu, China
  • 2Institute of Advanced Technology, Jiangnan University, Wuxi 214122, Jiangsu, China
  • 3Jiangsu Laboratory of Pattern Recognition and Computational Intelligence, Wuxi 214122, Jiangsu, China
  • 4School of Electronics and Information Engineering, Suzhou University of Science and Technology, Suzhou 215000, Jiangsu, China
  • show less

    To solve the challenges associated with the inadequate separation of source image features, low interpretability, and difficulty of designing accurate fusion rules, this paper proposes an infrared (IR) and visible image fusion method based on mutual information feature separation and representation, which effectively separates features while preserving the typical information of the source image. First, a mutual information constrained coding network is used to extract the features, maximize the mutual information between the source image and features to retain the feature representation of the source image, and minimize the mutual information of private and public features to achieve separation and representation. In addition, the loss function adopts a soft weighted intensity loss to balance the distribution of IR and visible features. Objective and subjective evaluation results of comparison experiments indicate that the proposed method can effectively fuse important information regarding IR and visible images and has good visual perception.

    Tools

    Get Citation

    Copy Citation Text

    Hui Wang, Xiaoqing Luo, Zhancheng Zhang. Infrared and Visible Image Fusion Based on Separate Expression of Mutual Information Features[J]. Laser & Optoelectronics Progress, 2023, 60(24): 2410002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Feb. 13, 2023

    Accepted: Apr. 7, 2023

    Published Online: Dec. 4, 2023

    The Author Email: Luo Xiaoqing (xqluo@jiangnan.edu.cn)

    DOI:10.3788/LOP230855

    Topics