Optics and Precision Engineering, Volume. 30, Issue 13, 1606(2022)

Hyperspectral reconstruction from RGB images based on Res2-Unet deep learning network

Beibei SONG1、*, Suina MA1, Fan HE1, and Wenfang SUN2
Author Affiliations
  • 1School of Information Engineering, Chang'an University, Xi'an70064, China
  • 2School of Aerospace Science and Technology, Xidian University, Xi'an71016, China
  • show less

    Because of hyperspectral imaging equipment are expensive, a deep learning network to reconstruct high-quality hyperspectral images from easily obtained RGB images was proposed. The proposed network was based on the Unet framework, and its backbone network was primarily constructed using the Res2Net module, which could extract fine local and global image features. The channel attention mechanism was introduced to adaptively adjust the channel characteristic response, and the information of different scales and depths was fully integrated through a skip connection between the coding and decoding paths. Finally, it was trained and tested on the dataset provided by the new trends in the image restoration and enhancement (NTIRE) 2020 international challenge. Experiments show that compared with the adaptive weighted attention network (AWAN) and hierarchical regression network (HRNet), the proposed method obtains the best results in the four objective evaluation methods, such as the mean of relative absolute error (MRAE), root mean square error (RMSE), peak signal-to-noise ratio (PSNR), and mean of spectral angle mapper (MSAM). Compared with AWAN and HRNet, the proposed method improves the mean of the PSNR by 0.08 dB and 1.73 dB, respectively, on the clean track, and 0.72 dB and 0.97 dB, respectively, on the real-world track. The proposed method reconstructs images with better subjective quality in the low-frequency flat area and the high-frequency texture area than the hyperspectral reference images.

    Tools

    Get Citation

    Copy Citation Text

    Beibei SONG, Suina MA, Fan HE, Wenfang SUN. Hyperspectral reconstruction from RGB images based on Res2-Unet deep learning network[J]. Optics and Precision Engineering, 2022, 30(13): 1606

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Information Sciences

    Received: Jul. 2, 2021

    Accepted: --

    Published Online: Jul. 27, 2022

    The Author Email: SONG Beibei (bbsong@chd.edu.cn)

    DOI:10.37188/OPE.2021.0433

    Topics