Laser & Optoelectronics Progress, Volume. 58, Issue 14, 1410008(2021)
Multiscale Nonlocal Neural Network for Single Image Deraining
Rainy day is a common severe weather, in which rain streaks seriously affect the accuracy of algorithms, such as object classification, detection, and segmentation. In a rain image, multiscale rain streaks have similar shape features, which make it possible to exploit such complementary information for the collaborative representation of rain streaks. In this study, we construct a multiscale feature pyramid structure to exploit the similarity features between different rain streaks and design the initial, convolutional long short-term memory network (Conv-LSTM), fusion, and reconstruction modules. In addition, we introduce a lightweight nonlocal mechanism in the fusion module to guide the fine fusion and removal of rain streak features. Extensive experiments were conducted on synthetic and real-world datasets. Compared with four recent deep learning-based single image deraining methods, the peak signal-to-noise ratio(PSNR) and structural similarity (SSIM) of the proposed method significantly improved. Experimental results show that the proposed method can effectively remove rain streaks and avoid image blur, while maintaining the original image information.
Get Citation
Copy Citation Text
Xueyan Zhang, Yanwei Pang. Multiscale Nonlocal Neural Network for Single Image Deraining[J]. Laser & Optoelectronics Progress, 2021, 58(14): 1410008
Category: Image Processing
Received: Sep. 28, 2020
Accepted: Nov. 14, 2020
Published Online: Jun. 30, 2021
The Author Email: Zhang Xueyan (xueyanzhang1995@tju.edu.cn)