Chinese Optics Letters, Volume. 21, Issue 5, 051101(2023)

Deep learning reconstruction enables full-Stokes single compression in polarized hyperspectral imaging On the Cover

Axin Fan1,2, Tingfa Xu1,2、*, Geer Teng1,3, Xi Wang4, Chang Xu1, Yuhan Zhang1,2, Xin Xu1,2, and Jianan Li1、**
Author Affiliations
  • 1Key Laboratory of Photoelectronic Imaging Technology and System of Ministry of Education of China, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
  • 2Beijing Institute of Technology Chongqing Innovation Center, Chongqing 401151, China
  • 3Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford OX3 7DQ, UK
  • 4School of Printing & Packaging Engineering, Beijing Institute of Graphic Communication, Beijing 102600, China
  • show less
    Figures & Tables(6)
    Overall schematic diagram of DL-FSCPHI method.
    The reconstruction strategy proposed in this work. F2 is the measured full-Stokes images, while G2 is the detected polarization-compressed images, containing N2 targets, Nλ2 spectral bands, and Nx × Ny spatial pixels. The epoch, the batch size, and the learning rate are parameters set for model training. The iepoch and the jbatch refer to training the ith epoch and jth batch. F1 is the full-Stokes images predicted from the detected polarization-compressed images G1, containing N1 targets and Nλ1 spectral bands.
    Measured and reconstructed full-Stokes images of three test targets in 6 spectral bands from 560 nm to 660 nm with an interval of 20 nm. The reconstructed images are marked with the PSNR and the SSIM values.
    PSNR and SSIM values of the reconstructed full-Stokes images of the three test targets in 18 spectral bands ranging from 520 nm to 690 nm at intervals of 10 nm.
    Loss curves of the training models under different settings, including two sets of training parameters (epoch = 20, batch size = 7 and epoch = 40, batch size = 5), two sets of polarization angles (θ = 114°, β = 0° and θ = 27°, β = 0°), and two convolution models (DL-M1 and DL-M2).
    • Table 1. Average PSNR and SSIM Values of the Reconstructed Full-Stokes Images of 7 Test Targets in 18 Spectral Bands under Different Settings, Including Two Sets of Polarization Angles (θ = 114°, β = 0° and θ = 27°, β = 0°), Two Convolution Models and One Traditional Algorithm (DL-M1, DL-M2, and TwIST), and Two Sets of Training Parameters (Epoch = 20, Batch Size = 7 and Epoch = 40, Batch Size = 5)

      View table
      View in Article

      Table 1. Average PSNR and SSIM Values of the Reconstructed Full-Stokes Images of 7 Test Targets in 18 Spectral Bands under Different Settings, Including Two Sets of Polarization Angles (θ = 114°, β = 0° and θ = 27°, β = 0°), Two Convolution Models and One Traditional Algorithm (DL-M1, DL-M2, and TwIST), and Two Sets of Training Parameters (Epoch = 20, Batch Size = 7 and Epoch = 40, Batch Size = 5)

      θ = 27°, β = 0°DL-M1DL-M2TwIST
      Evaluation metricsEpoch = 20Epoch = 40Epoch = 20Epoch = 40Accuracy = 0.005
      Batch size = 7Batch size = 5Batch size = 7Batch size = 5
      PSNR/dBS037.5838.0438.9538.7629.37
      S122.1722.6222.0622.2710.96
      S224.8725.1724.3825.2210.37
      S332.6333.5731.2032.199.85
      Average29.3129.8529.1529.6115.14
      SSIMS01.001.001.001.001.00
      S100.800.820.800.810.52
      S20.890.900.870.880.52
      S30.980.980.970.970.52
      Average0.920.920.910.920.64
    Tools

    Get Citation

    Copy Citation Text

    Axin Fan, Tingfa Xu, Geer Teng, Xi Wang, Chang Xu, Yuhan Zhang, Xin Xu, Jianan Li. Deep learning reconstruction enables full-Stokes single compression in polarized hyperspectral imaging[J]. Chinese Optics Letters, 2023, 21(5): 051101

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems and Image Processing

    Received: Dec. 18, 2022

    Accepted: Feb. 23, 2023

    Posted: Feb. 24, 2023

    Published Online: May. 10, 2023

    The Author Email: Tingfa Xu (ciom_xtf1@bit.edu.cn), Jianan Li (lijianan@bit.edu.cn)

    DOI:10.3788/COL202321.051101

    Topics