Optics and Precision Engineering, Volume. 31, Issue 21, 3212(2023)
Underwater polarization image fusion based on unsupervised learning and attention mechanisms
As light propagation in water is subject to absorption and scattering effects, acquiring underwater images using conventional intensity cameras can result in low brightness of imaging results, blurred images, and loss of details. In this study, a deep fusion network was applied to underwater polarimetric images; the underwater polarimetric images were fused with light-intensity images using deep learning. First, the underwater active polarization imaging model was analyzed, an experimental setup was built to obtain underwater polarization images to construct a training dataset, and appropriate transformations were performed to expand the dataset. Second, an end-to-end learning framework was constructed based on unsupervised learning and guided by attention mechanism for fusing polarimetric and light intensity images and the loss function and weight parameters were elaborated. Finally, the produced dataset was used to train the network under different loss weight parameters and the fused images were evaluated based on different image evaluation metrics. The experimental results show that the fused underwater images are more detailed, with 24.48% higher information entropy and 139% higher standard deviation than light-intensity images. Unlike other traditional fusion algorithms, the method does not require manual weight parameter adjustment, has faster operation speed, strong robustness, and self-adaptability, which is important for ocean detection and underwater target recognition.
Get Citation
Copy Citation Text
Wenzhe GONG, Jinkui CHU, Haoyuan CHENG, Ran ZHANG. Underwater polarization image fusion based on unsupervised learning and attention mechanisms[J]. Optics and Precision Engineering, 2023, 31(21): 3212
Category:
Received: Feb. 23, 2023
Accepted: --
Published Online: Jan. 5, 2024
The Author Email: ZHANG Ran (zhangr@dlut.edu.cn)