HDR Image Reconstruction Algorithm Based on Masked Transformer

Zuheng Zhang; Xiaodong Chen; Yi Wang; Huaiyu Cai

doi:10.3788/LOP241132

Laser & Optoelectronics Progress, Volume. 62, Issue 2, 0237009(2025)

HDR Image Reconstruction Algorithm Based on Masked Transformer

Zuheng Zhang^*, Xiaodong Chen, Yi Wang, and Huaiyu Cai

Key Laboratory of Opto-Electronics Information Technology of Ministry of Education, College of Precision Instrument and Opto-Electronic Engineering, Tianjin University, Tianjin 300072, China

show less

Abstract Get PDF(in Chinese)

Figures & Tables(13)

Fig. 1. Algorithmic framework for HDR image reconstruction based on bracketed image stack generation

Download full size

Fig. 2. Schematic of bracketed image stack generation using a recursive approach

Download full size

Fig. 3. Masked-transformer-based image generation network and related modules

Download full size

Fig. 4. Mask acquisition method

Download full size

Fig. 5. Role of global and local information in bracketed image stack generation

Download full size

Fig. 6. Masking operation realization process

Download full size

Fig. 7. Comparison of different algorithms for HDR image reconstruction. (a) Input image; (b) ground truth; (c) Ref. [15]; (d) Ref. [13]; (e) Ref. [20]; (f) proposed method

Download full size

Fig. 8. Residual blocks for replacing MT modules

Download full size

Fig. 9. Subjective evaluation of the results of ablation experiments. (a) Input image; (b) ground truth; (c) group 1; (d) group 2; (e) group 3

Download full size

Fig. 10. Sample of attention map. (a) First layer; (b) bottleneck; (c) final layer

Download full size

Table 1. Quantitative comparison of bracketed image stack generation

View table

Table 1. Quantitative comparison of bracketed image stack generation

Image	Method	PSNR /dB		SSIM		MS-SSIM
Image	Method	m	σ	m	σ	m	σ
EV+3	Proposed	30.95	3.68	0.935	0.059	0.982	0.014
EV+3	Ref. ［20］	28.88	4.90	0.878	0.056	0.962	0.028
EV+2	Proposed	31.45	3.40	0.939	0.056	0.986	0.012
EV+2	Ref. ［20］	30.54	3.03	0.930	0.030	0.977	0.013
EV+1	Proposed	33.74	3.73	0.957	0.036	0.991	0.008
EV+1	Ref. ［20］	30.75	3.25	0.936	0.042	0.985	0.009
EV－1	Proposed	30.97	3.69	0.930	0.043	0.989	0.009
EV－1	Ref. ［20］	30.25	3.35	0.916	0.044	0.979	0.010
EV－2	Proposed	30.42	4.83	0.927	0.049	0.990	0.017
EV－2	Ref. ［20］	28.30	3.03	0.906	0.055	0.968	0.014
EV－3	Proposed	28.46	3.52	0.890	0.060	0.963	0.021
EV－3	Ref. ［20］	27.62	3.63	0.859	0.057	0.960	0.017

Table 2. Quantitative comparison of HDR image generation

View table

Table 2. Quantitative comparison of HDR image generation

Image	Method	PSNR /dB （Reinhard’s TMO）		PSNR /dB （Kim&Kautz’s TMO）		HDR-VDP-2 （Q score）
Image	Method	m	σ	m	σ	m	σ
VDS	Proposed	32.14	3.40	30.32	3.74	61.09	5.95
	Ref. ［15］	27.72	1.98	26.00	2.16	55.64	6.24
	Ref. ［13］	18.26	1.93	17.33	3.21	42.49	4.62
	Ref. ［20］	29.77	2.98	28.07	2.83	55.74	5.35
HDR Eye	Proposed	23.41	2.04	23.31	2.49	46.11	4.61
	Ref. ［15］	22.81	3.26	22.56	2.56	45.84	5.45
	Ref. ［13］	16.65	2.00	17.31	3.09	43.16	4.61
	Ref. ［20］	22.08	2.46	22.73	2.66	45.95	4.59

Table 3. Quantitative comparison of HDR image generation

View table

Table 3. Quantitative comparison of HDR image generation

Image	Group	PSNR /dB （Reinhard’s TMO）		PSNR /dB （Kim&Kautz’s TMO）		HDR-VDP-2 （Q score）
Image	Group	m	σ	m	σ	m	σ
VDS	Group 1	29.83	4.53	28.06	3.61	54.03	5.12
	Group 2	31.35	3.93	29.05	4.50	60.08	5.61
	Group 3	32.14	3.40	30.32	3.74	61.09	5.95
HDR eye	Group 1	21.24	2.13	20.57	2.80	43.89	4.78
	Group 2	23.23	2.34	22.88	2.02	45.94	4.60
	Group 3	23.41	2.04	23.31	2.49	46.11	4.61

Tools

Get Citation

Copy Citation Text

Zuheng Zhang, Xiaodong Chen, Yi Wang, Huaiyu Cai. HDR Image Reconstruction Algorithm Based on Masked Transformer[J]. Laser & Optoelectronics Progress, 2025, 62(2): 0237009

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Digital Image Processing

Received: Apr. 22, 2024

Accepted: May. 31, 2024

Published Online: Jan. 3, 2025

The Author Email:

DOI:10.3788/LOP241132

CSTR:32186.14.LOP241132

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology