Laser & Optoelectronics Progress, Volume. 61, Issue 14, 1437007(2024)

Infrared Visible Image Registration Based on Gabor Representation Feature Descriptor

Jing Xu1、*, Lidong Bao1, Ming Fang2,3, and Tianjiao Du1
Author Affiliations
  • 1School of Computer Science and Technology, Changchun University of Science and Technology, Changchun 130022, Jilin , China
  • 2School of Artificial Intelligence, Changchun University of Science and Technology, Changchun 130022, Jilin , China
  • 3Zhongshan Institute of Changchun University of Science and Technology, Zhongshan 528403, Guangdong , China
  • show less

    In the realm of unmanned aerial vehicle aerial photography, images obtained from disparate sensors often exhibit significant parallax and resolution disparities, which can lead to failures in image registration processes. Addressing this challenge, this study introduces an innovative approach for the registration of infrared and visible light images, utilizing a rotation-invariant Gabor representation descriptor. The methodology commences by resolving the image's weighted matrix, followed by the application of the Harris algorithm to the weighted matrix within the context of phase congruence, thereby pinpointing the image's key features. Subsequently, the Gabor representation framework is refined to precisely ascertain the orientation of key features, effectively mitigating the impact of substantial parallax. To further enhance the process, the nearest neighbor matching (NNM) algorithm, in tandem with fast sampling consistency (FSC), is deployed to filter out outliers and augment the accuracy of matches. The technique demonstrates an average accuracy of 46%, 72%, and 62% across the CVC-15 stereo, LWIR-RGB long-wave infrared, and proprietary datasets, respectively. Correspondingly, the average processing times are 6.886 seconds, 7.800 seconds, and 9.631 seconds. Experimental results prove that the efficacy of the proposed method, particularly in scenarios where the images to be registered present considerable parallax and resolution differences.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Jing Xu, Lidong Bao, Ming Fang, Tianjiao Du. Infrared Visible Image Registration Based on Gabor Representation Feature Descriptor[J]. Laser & Optoelectronics Progress, 2024, 61(14): 1437007

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Digital Image Processing

    Received: Dec. 4, 2023

    Accepted: Dec. 26, 2023

    Published Online: Jul. 8, 2024

    The Author Email: Jing Xu (xujing@cust.edu.cn)

    DOI:10.3788/LOP232611

    CSTR:32186.14.LOP232611

    Topics