Infrared and visible image fusion guided by cross-domain interactive attention and contrastive learning

Jing DI; Chan LIANG; Ji-zhao LIU; Jing LIAN

doi:10.37188/CO.2024-0147

[1] ARCHANA R, JEEVARAJ P S E. Deep learning models for digital image processing: a review[J]. Artificial Intelligence Review, 57, 11(2024).

[2] LI H, WU X J. CrossFuse: a novel cross attention mechanism based infrared and visible image fusion approach[J]. Information Fusion, 103, 102147(2024).

[3] YANG B, HU Y X, LIU X W et al. CEFusion: an infrared and visible image fusion network based on cross-modal multi-granularity information interaction and edge guidance[J]. IEEE Transactions on Intelligent Transportation Systems, 25, 17794-17809(2024).

[4] NAHATA D, OTHMAN K, NAHATA D et al. Exploring the challenges and opportunities of image processing and sensor fusion in autonomous vehicles: a comprehensive review[J]. AIMS Electronics and Electrical Engineering, 7, 271-321(2023).

[5] CHENG B Y, LI T, WANG Y L. Fusion of infrared and visible light images based on visual saliency weighting and maximum gradient singular value[J]. Chinese Optics, 15, 675-688(2022).

[6] [6] ZHANG Y M, LEE H J. Infrared visible image fusion based on multiscale decomposition texture preservation model[C]. Proceedings of 2021 International Conference on Computer Engineering Artificial Intelligence (ICCEAI), IEEE, 2021: 335339.

[7] GAO M L, ZHOU Y N, ZHAI W ZH et al. SaReGAN: a salient regional generative adversarial network for visible and infrared image fusion[J]. Multimedia Tools and Applications, 83, 61659-61671(2023).

[8] LI X L, LI Y F, CHEN H J et al. RITFusion: reinforced interactive transformer network for infrared and visible image fusion[J]. IEEE Transactions on Instrumentation and Measurement, 73, 5000916(2024).

[9] CHEN J, LI X J, LUO L B et al. Infrared and visible image fusion based on target-enhanced multiscale transform decomposition[J]. Information Sciences, 508, 64-78(2020).

[10] LIU X H, CHEN ZH B, QIN M Z. Infrared and visible image fusion using guided filter and convolutional sparse representation[J]. Optics and Precision Engineering, 26, 1242-1253(2018).

[11] LI Y H, LIU G, BAVIRISETTI D P et al. Infrared-visible image fusion method based on sparse and prior joint saliency detection and LatLRR-FPDE[J]. Digital Signal Processing, 134, 103910(2023).

[12] LIU Y, CHEN X, WARD R K et al. Image fusion with convolutional sparse representation[J]. IEEE Signal Processing Letters, 23, 1882-1886(2016).

[13] [13] PRABHAKAR K R, SRIKAR V S, VENKATESH BABU R. DeepFuse: a deep unsupervised approach f exposure fusion with extreme exposure image pairs[C]. Proceedings of the 2017 IEEE International Conference on Computer Vision, IEEE, 2017: 47244732.

[14] LI H, WU X J, DURRANI T. NestFuse: an infrared and visible image fusion architecture based on nest connection and spatial/channel attention models[J]. IEEE Transactions on Instrumentation and Measurement, 69, 9645-9656(2020).

[15] LI H, WU X J, KITTLER J. RFN-Nest: an end-to-end residual fusion network for infrared and visible images[J]. Information Fusion, 73, 72-86(2021).

[16] MA J Y, TANG L F, FAN F et al. SwinFusion: cross-domain long-range learning for general image fusion via Swin transformer[J]. IEEE/CAA Journal of Automatica Sinica, 9, 1200-1217(2022).

[17] [17] ZHAO Z X, BAI H W, ZHANG J SH, et al. CDDFuse: crelationdriven dualbranch feature decomposition f multimodality image fusion[C]. Proceedings of the 2023 IEEECVF Conference on Computer Vision Pattern Recognition, IEEE, 2023: 59065916.

[18] WANG X, GUAN ZH, QIAN W H et al. CS²Fusion: contrastive learning for self-supervised infrared and visible image fusion by estimating feature compensation map[J]. Information Fusion, 102, 102039(2024).

[19] [19] HE K M, FAN H Q, WU Y X, et al. Momentum contrast f unsupervised visual representation learning[C]. Proceedings of the 2020 IEEECVF Conference on Computer Vision Pattern Recognition, IEEE, 2020: 97269735.

[20] XU H, MA J Y, JIANG J J et al. U2Fusion: a unified unsupervised image fusion network[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 502-518(2022).

[21] TANG L F, YUAN J T, ZHANG H et al. PIAFusion: a progressive infrared and visible image fusion network based on illumination aware[J]. Information Fusion, 83-84, 79-92(2022).

[22] TANG L F, DENG Y X, MA Y et al. SuperFusion: a versatile image registration and fusion network with semantic awareness[J]. IEEE/CAA Journal of Automatica Sinica, 9, 2121-2137(2022).

[23] TANG L F, YUAN J T, MA J Y. Image fusion in the loop of high-level vision tasks: a semantic-aware real-time infrared and visible image fusion network[J]. Information Fusion, 82, 28-42(2022).

[24] [24] LIU J Y, FAN X, HUANG ZH B, et al. Targetaware dual adversarial learning a multiscenario multimodality benchmark to fuse infrared visible f object detection[C]. Proceedings of the 2022 IEEECVF Conference on Computer Vision Pattern Recognition, IEEE, 2022: 57925801.

[25] TANG L F, XIANG X Y, ZHANG H et al. DIVFusion: darkness-free infrared and visible image fusion[J]. Information Fusion, 91, 477-493(2023).

[26] [26] ZHAO Z X, BAI H W, ZHU Y ZH, et al. DDFM: denoising diffusion model f multimodality image fusion[C]. Proceedings of the 2023 IEEECVF International Conference on Computer Vision, IEEE, 2023: 80488059.

[27] LI H, XU T Y, WU X J et al. LRRNet: a novel representation learning guided fusion network for infrared and visible images[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45, 11040-11052(2023).

[28] CHEN H R, DENG L, CHEN ZH X et al. SFCFusion: spatial-frequency collaborative infrared and visible image fusion[J]. IEEE Transactions on Instrumentation and Measurement, 73, 5011615(2024).

[29] LIU J Y, LIN R J, WU G Y et al. CoCoNet: coupled contrastive learning network with multi-level feature ensemble for multi-modality image fusion[J]. International Journal of Computer Vision, 132, 1748-1775(2024).