Infrared and Laser Engineering, Volume. 49, Issue S1, 20200093(2020)

Hyperspectral images reconstruction using adversarial networks from single RGB image

Liu Pengfei1,2,3,4,5, Zhao Huaici1,2,4,5、*, and Li Peixuan1,2,3,4,5
Author Affiliations
  • 1[in Chinese]
  • 2[in Chinese]
  • 3[in Chinese]
  • 4[in Chinese]
  • 5[in Chinese]
  • show less

    Hyperspectral imaging can provide more spectral information than an ordinary RGB camera. The spectral information has been beneficial to numerous applications, such as monitoring natural environment changes and classifying plants and soils in agriculture. The hyperspectral images reconstruction from a single RGB image is severely unconstrained problem. Previous methods need additional components or the spectral response by commercial camera. An end-to-end conditional generative adversarial network was proposed with modified residual network as backbone. The feature pyramid was used inside the network and a scale attention module was designed to fuse local and global information. In order to provide more accurate solution, another distinct architecture was proposed, named WNet. Experiments manifested the superiority of the proposed method over other representative methods in terms of quality and quantity. Experiments used both synthesized RGB images using public hyperspectral data and real-world image by ordinary camera demonstrate that proposed method outperforms the state-of-the-art. The WNet drops 45% and 50% in terms of RMSE and relative RMSE on the ICVL dataset than sparse coding.

    Tools

    Get Citation

    Copy Citation Text

    Liu Pengfei, Zhao Huaici, Li Peixuan. Hyperspectral images reconstruction using adversarial networks from single RGB image[J]. Infrared and Laser Engineering, 2020, 49(S1): 20200093

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: 图像处理

    Received: Apr. 2, 2020

    Accepted: May. 5, 2020

    Published Online: Feb. 5, 2021

    The Author Email: Huaici Zhao (hczhao@sia.cn)

    DOI:10.3788/irla20200093

    Topics