Dual-Stage Multimodal Image-Registration Method Integrating Structural Information

Zhengwei Yang; Junwei Huang; Chao Feng; Xia Li; Zelong Zhang

doi:10.3788/LOP242186

Laser & Optoelectronics Progress, Volume. 62, Issue 12, 1228006(2025)

Dual-Stage Multimodal Image-Registration Method Integrating Structural Information

Zhengwei Yang¹, Junwei Huang^2、*, Chao Feng¹, Xia Li², and Zelong Zhang¹

¹Yunnan Institute of Water & Hydropower Engineering Investigation, Design and Research Co., Ltd., Kunming 650021, Yunnan , China

²Yunnan Institute of Water & Hydropower Engineering Investigation, Design and Research, Kunming 650021, Yunnan , China

show less

Abstract Get PDF(in Chinese)

Figures & Tables(9)

Fig. 1. Flowchart of the proposed algorithm

Download full size

Fig. 2. Feature point detection. (a) Input image pair; (b) minimum moment map; (c) maximum moment map; (d) feature point detection results

Download full size

Fig. 3. RIFT feature description and matching. (a) Maximum index map; (b) FREAK descriptor; (c) feature point matching results

Download full size

Fig. 4. Template feature generation process. (a) Input image; (b) initial template features; (c) 3D Gaussian convolution kernel; (d) 3D template features

Download full size

Fig. 5. Experimental original images. (a) Optical-optical; (b) optical-infrared; (c) optical-depth; (d) optical-map; (e) optical-SAR; (f) day-night

Download full size

Fig. 6. Matching results. (a) Optical-optical; (b) optical-infrared; (c) optical-depth; (d) optical-map; (e) optical-SAR; (f) day-night

Download full size

Fig. 7. Checkerboard mosaic images. (a) Optical-optical; (b) optical-infrared; (c) optical-depth; (d) optical-map; (e) optical-SAR; (f) day-night

Download full size

Table 1. Quantitative results of comparative experiments

View table

Table 1. Quantitative results of comparative experiments

Method		SAR-SIFT	RIFT	SRIF	Proposed
NCM /pair	Optical-optical	5.32	154.2	186.6	542.1
	Optical-infrared	—	118.3	163.7	548.4
	Optical-depth	—	82.1	193.1	560.5
	Optical-map	—	101.5	152.2	503.2
	Optical-SAR	8.64	120.1	158.2	321.5
	Day-night	2.58	114.4	147.6	351.1
RMSE /pixel	Optical-optical	4.31	1.79	1.35	0.89
	Optical-infrared	—	1.94	1.43	0.94
	Optical-depth	—	2.11	1.57	1.27
	Optical-map	—	2.16	1.76	1.43
	Optical-SAR	3.62	2.28	1.81	1.40
	Day-night	4.62	1.92	1.64	1.03
SR /%	Optical-optical	30	100	100	100
	Optical-infrared	—	100	100	100
	Optical-depth	—	100	100	100
	Optical-map	—	100	100	100
	Optical-SAR	20	100	100	100
	Day-night	30	100	100	100
Time /s	Optical-optical	10.53	50.45	17.61	43.93
	Optical-infrared	9.05	53.26	14.83	39.21
	Optical-depth	7.57	48.91	18.67	41.47
	Optical-map	7.26	42.95	14.56	43.25
	Optical-SAR	10.56	58.23	17.46	46.34
	Day-night	11.08	56.32	16.21	42.16

Table 2. Ablation experiment results

View table

Table 2. Ablation experiment results

Method		T0	T1	T2	T3
RMSE /pixel	Optical-optical	0.89	1.79	2.26	1.25
	Optical-infrared	0.94	1.94	2.45	1.38
	Optical-depth	1.27	2.11	2.97	1.62
	Optical-map	1.43	2.16	2.86	1.57
	Optical-SAR	1.40	2.28	2.91	2.09
	Day-night	1.03	1.92	2.71	1.73
Time /s	Optical-optical	43.93	50.45	20.64	29.78
	Optical-infrared	39.21	53.26	19.23	29.04
	Optical-depth	41.47	48.91	19.87	32.47
	Optical-map	43.25	42.95	20.13	31.76
	Optical-SAR	46.34	58.23	21.52	34.19
	Day-night	42.16	56.32	20.07	30.83

Tools

Get Citation

Copy Citation Text

Zhengwei Yang, Junwei Huang, Chao Feng, Xia Li, Zelong Zhang. Dual-Stage Multimodal Image-Registration Method Integrating Structural Information[J]. Laser & Optoelectronics Progress, 2025, 62(12): 1228006

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Remote Sensing and Sensors

Received: Oct. 28, 2024

Accepted: Jan. 2, 2025

Published Online: Jun. 25, 2025

The Author Email: Junwei Huang (864684545@qq.com)

DOI:10.3788/LOP242186

CSTR:32186.14.LOP242186

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology