Laser & Optoelectronics Progress, Volume. 59, Issue 20, 2011010(2022)
End-to-End Computational Imaging Based on Multispectral Fusion
Traditional methods for improving the quality of low-illumination imaging include external supplementary light and expanding the aperture, and complete source information enhancement by increasing the physical light input. However, these methods have been proposed to cause problems, such as light source pollution and shortening of the depth of field. Therefore, this paper proposes an end-to-end multispectral fusion scheme to achieve high-quality computational imaging, thereby effectively restoring the color and details of objects in low-illumination scenes while making up for the shortcomings of traditional methods. First, the multi-channel spectral information was integrated through a custom-designed deep learning network, after which scene noise was effectively eliminated. As a result, we discovered that the proposed method had a high degree of freedom, could adjust number of channels and network parameters according to the needs of specific conditions, replaced the traditional camera module, and optimized the image signal processing process. Next, we conducted detailed ablation experiments. The results show that after spectral fusion, the mean square error (MSE) and perceptual loss of image quality obtained by the proposed method reduce by 54.43% and 35.12%, respectively, compared with that obtained by traditional methods based on RGB data. Thus, the successful proposal and verification of this study's method should serve as a background for new high-quality imaging solutions within complex application scenarios, such as augmented reality/virtual reality (AR/VR), medical imaging, and autonomous driving.
Get Citation
Copy Citation Text
Yilan Nan, Junfei Shen, Qican Zhang. End-to-End Computational Imaging Based on Multispectral Fusion[J]. Laser & Optoelectronics Progress, 2022, 59(20): 2011010
Category: Imaging Systems
Received: Aug. 15, 2022
Accepted: Sep. 9, 2022
Published Online: Oct. 13, 2022
The Author Email: Shen Junfei (shenjunfei@scu.edu.cn)