Advanced Photonics Nexus, Volume. 4, Issue 5, 056002(2025)

Snapshot multispectral imaging through defocusing and a Fourier imager network

Xilin Yang1,2,3, Michael John Fanous1, Hanlong Chen1,2,3, Ryan Lee1, Paloma Casteleiro Costa1,2,3, Yuhang Li1,2,3, Luzhe Huang1,2,3, Yijie Zhang1,2,3, and Aydogan Ozcan1,2,3、*
Author Affiliations
  • 1University of California, Los Angeles, Electrical and Computer Engineering Department, Los Angeles, California, United States
  • 2University of California, Los Angeles, Bioengineering Department, Los Angeles, California, United States
  • 3University of California, Los Angeles, California NanoSystems Institute (CNSI), Los Angeles, California, United States
  • show less
    Figures & Tables(8)
    (a) Schematic layout: overview of the snapshot multispectral imaging system, illustrating the arrangement of the circular LED array, the digital micromirror device (DMD), optical components (collimator, diffuser, and lenses), and the monochrome imaging camera. (b) Experimental setup.
    (a) and (b) Visualizations of image reconstruction results of two test image patterns illuminated under different wavelengths. Each column refers to an image with the monochrome defocused sensor input, network output, and multispectral target (ground truth). Pseudo colors represent the corresponding illumination LED color (center wavelength).
    Visualization of image reconstruction results under various illumination configurations. Each column displays the predicted image alongside the corresponding target (ground truth) image for different combinations of activated LEDs that were on.
    Image reconstruction performance analysis. (a) Confusion matrix of spectral channel accuracy. (b) Classification metrics against the number of concurrent LED illuminations: Plots of sensitivity, specificity, and F1 score against the number of concurrent LED illuminations. (c) Energy difference values as a function of the number of concurrent LED illuminations; boxplots depict the distribution of energy differences for various numbers of concurrent illuminations, indicating the shift in the prediction accuracy and variance. (d) Energy difference values as a function of the illumination wavelengths. We used light green to signify “losses” and light blue for “leakages.”
    Distributions of (a) PSNR, (b) RMSE, (c) SSIM, and (d) NMSE metrics for the reconstructed images at different illumination wavelengths.
    (a) Distributions of structural quality metrics for the reconstructed multispectral images with respect to the number of concurrent LED illuminations. (b) Confusion matrices with different numbers of concurrent LED illuminations.
    Reconstruction results on synthetic test data with dual-LED spectral illumination on different patterns. Each test input simulates a monochrome snapshot formed by the superposition of two independent single-channel illuminations on two distinct image patterns. The mFIN-generated spectral reconstructions (left) are compared against the combined ground truth targets (right, in each column).
    Network architecture. (a) mFIN. (b) Dense links: each output tensor of the dSPAF group is appended and fed to the subsequent one. (c) Detailed schematic of dSPAF modules. See Sec. 4 for details.
    Tools

    Get Citation

    Copy Citation Text

    Xilin Yang, Michael John Fanous, Hanlong Chen, Ryan Lee, Paloma Casteleiro Costa, Yuhang Li, Luzhe Huang, Yijie Zhang, Aydogan Ozcan, "Snapshot multispectral imaging through defocusing and a Fourier imager network," Adv. Photon. Nexus 4, 056002 (2025)

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Research Articles

    Received: Jan. 25, 2025

    Accepted: Jul. 21, 2025

    Published Online: Aug. 5, 2025

    The Author Email: Aydogan Ozcan (ozcan@ucla.edu)

    DOI:10.1117/1.APN.4.5.056002

    CSTR:32397.14.1.APN.4.5.056002

    Topics