Chinese Journal of Liquid Crystals and Displays, Volume. 38, Issue 11, 1580(2023)

Hybrid distortion image correction method based on improved U-Net networks

Wei SONG1, Li-biao SHI1, Li-jia GENG2, Zhen-ling MA1、*, and Yan-ling DU1
Author Affiliations
  • 1College of Information,Shanghai Ocean University,Shanghai 201306,China
  • 2East China Sea Standard Metrology Center,State Oceanic Administration,Shanghai 201306,China
  • show less

    Image geometric distortion correction is a key pre-processing step for many computer vision applications. Current geometric distortion correction methods based on deep learning mainly solve the problems of single distortion correction of images. For this reason, this paper proposes a hybrid distortion correction method for images with improved U-Net networks. Firstly, a method is proposed to construct hybrid distortion image datasets, which solves the problems of sparse training dataset and single distortion type. Secondly, the U-Net with spatial attention for image feature extraction and reconstruction of the distortion coordinate map is used to turn the image correction problem into a prediction problem of the pixel-by-pixel coordinate displacement change of the distorted image, and a loss function combining coordinate difference loss and image resampling loss is designed to effectively improve the correction accuracy. Finally, the performance of each module of the method in this paper is verified by ablation experiments. Compared with the latest deep learning-based distortion correction methods, the experimental results show that the method in this paper has better performance in terms of quantitative indexes and subjective evaluation, and reaches 0.251 9 of the mean absolute error for coordinate correction of distorted images. Calibration experiments on the optical images acquired by GoPro cameras have further verified the effectiveness of the proposed method in practice.

    Tools

    Get Citation

    Copy Citation Text

    Wei SONG, Li-biao SHI, Li-jia GENG, Zhen-ling MA, Yan-ling DU. Hybrid distortion image correction method based on improved U-Net networks[J]. Chinese Journal of Liquid Crystals and Displays, 2023, 38(11): 1580

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Research Articles

    Received: Nov. 21, 2022

    Accepted: --

    Published Online: Nov. 29, 2023

    The Author Email: Zhen-ling MA (zlma@shou.edu.cn)

    DOI:10.37188/CJLCD.2022-0387

    Topics