Laser & Optoelectronics Progress, Volume. 59, Issue 20, 2011010(2022)

End-to-End Computational Imaging Based on Multispectral Fusion

Yilan Nan, Junfei Shen*, and Qican Zhang
Author Affiliations
  • College of Electronics and Information Engineering, Sichuan University, Chengdu 610065, Sichuan, China
  • show less
    Figures & Tables(17)
    Example of camera imaging
    Example of camera response curves
    Implementation flow chart of the proposed method
    Multispectral fusion algorithm block
    Structure of U-Net model
    Flow chart of the perceptual loss
    Preprocessed data and ground truth
    Comparison of experimental results
    Image edge evaluation
    Color reconstruction evaluation
    Image detail evaluation
    Real multispectral data imaging test
    Comparison of different input data in ablation experiment
    Output comparison of networks with different structures
    • Table 1. Performance of networks trained with different data on test set

      View table

      Table 1. Performance of networks trained with different data on test set

      ParameterMultispectral dataRGB
      MSE0.01440.0316
      PSNR /dB36.832828.0062
      SSIM0.88590.6447
      Perceptual loss2.32873.5890
    • Table 2. Robust test of different networks

      View table

      Table 2. Robust test of different networks

      NoiseLossMultispectral dataRGB
      25%Loss 10.02450.0469
      Loss 22.42944.1494
      50%Loss 10.01440.0316
      Loss 22.32873.5890
      75%Loss 10.03890.0635
      Loss 22.91364.6799
    • Table 3. Performance of networks with different structures on test set

      View table

      Table 3. Performance of networks with different structures on test set

      NetworkMSEPSNR /dBPerceptual loss
      U-Net0.021533.35122.5089
      SE-UNet0.018434.70362.4657
      Cbam-UNet0.022832.84132.5217
      Res-UNet0.014436.83282.3287
    Tools

    Get Citation

    Copy Citation Text

    Yilan Nan, Junfei Shen, Qican Zhang. End-to-End Computational Imaging Based on Multispectral Fusion[J]. Laser & Optoelectronics Progress, 2022, 59(20): 2011010

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems

    Received: Aug. 15, 2022

    Accepted: Sep. 9, 2022

    Published Online: Oct. 13, 2022

    The Author Email: Shen Junfei (shenjunfei@scu.edu.cn)

    DOI:10.3788/LOP202259.2011010

    Topics