Infrared and Laser Engineering, Volume. 50, Issue S2, 20200520(2021)

Registration of thermal infrared image and visible image based on featured contour quadrilateral

Yu Zhi1, Juanjuan Zhu1, Rui Liu2, and Haidong Zhang2
Author Affiliations
  • 1College of Space Science and Technology, Xidian University, Xi'an 710071, China
  • 2Shenzhen Fairair Technology Co., Ltd, Shenzhen 518133, China
  • show less
    Figures & Tables(16)
    Flow chart of the proposed algorithm in this paper
    Detection of contour feature points
    Featured contour. (a), (d) Contours of thermal infrared image and visible light image extracted by traditional method; (b), (e) Polygon approximation of contours in reference [10]; (c), (f) Featured contours extracted by proposed FCQ algorithm
    Feature contours of thermal infrared and visible images extracted under complex background
    [in Chinese]
    Algorithm flow chart for generating featured contour quadrilateral
    Calculation of displacement variable deviation value
    The first registration result of thermal infrared image and visible image in experiment 1
    The second group of thermal infrared image and visible image registration results in experiment 1. (a), (b) Thermal infrared image and its featured contour quadrilateral; (c), (d) Visible image and its featured contour quadrilateral; (e), (f) Registration graph and fusion graph of the FCQ algorithm using improved homography transformation; (g), (h) Registration graph and the fusion graph of FCQ algorithm applying traditional homography transformation
    [in Chinese]
    [in Chinese]
    Registration results of thermal infrared image and visible image in experiment 2
    Registration result of thermal infrared image and visible image in experiment 3. (a) Thermal infrared image; (b) Visible image; (c) Registration image; (d) Fusion image; (e),(f) Registration graph and the fusion graph without applying the IHT
    [in Chinese]
    • Table 1. Registration matrix parameters in experiments

      View table
      View in Article

      Table 1. Registration matrix parameters in experiments

      ${a_{00}}$${a_{11}}$${t_x}$${t_y}$
      Experiment 10.8840.82731.652-10.976
      Experiment 20.805 60.894 138.04713.425
      Experiment 30.8490.87838.283-21.244
    • Table 2. MSE, RMSE of the three experiments and the comparison groups

      View table
      View in Article

      Table 2. MSE, RMSE of the three experiments and the comparison groups

      AlgorithmsMSERMSE
      SURF- experiment 16.033 3
      FCQ-experiment 1 without IHT3.073 7
      FCQ-experiment 1 with IHT1.520 31.233 0
      SURF-experiment 29.273 6
      FCQ-experiment 2 without IHT2.240 0
      FCQ-experiment 2 with IHT1.144 41.069 8
      SURF-Experiment 39.445 6
      FCQ-experiment 3 without IHT2.107 2
      FCQ-experiment 3 with IHT1.593 51.262 0
      Ref. [10] 6.838 22.615 0
      Ref. [12] 2.459 41.568 2
    Tools

    Get Citation

    Copy Citation Text

    Yu Zhi, Juanjuan Zhu, Rui Liu, Haidong Zhang. Registration of thermal infrared image and visible image based on featured contour quadrilateral[J]. Infrared and Laser Engineering, 2021, 50(S2): 20200520

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image processing

    Received: Nov. 26, 2020

    Accepted: --

    Published Online: Dec. 3, 2021

    The Author Email:

    DOI:10.3788/IRLA20200520

    Topics