Journals Articles Conferences News About CLP
Submit a paper Email Alert
Search
Search
Articles
Journals
News
Advanced Search
Top Searches
2D MaterialsTransformation opticsQuantum PhotonicsSmall lasersSemiconductor UV PhotonicsSupersymmetric microring laser arrays

Photonics Research, Volume. 13, Issue 2, 511(2025)

Lensless efficient snapshot hyperspectral imaging using dynamic phase modulation Editors' Pick

Chong Zhang1,2, Xianglei Liu3,7, Lizhi Wang4, Shining Ma1, Yuanjin Zheng5, Yue Liu1,2, Hua Huang6, Yongtian Wang1, and Weitao Song1,2、*
Author Affiliations
  • 1Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
  • 2Zhengzhou Research Institute, Beijing Institute of Technology, Zhengzhou 450000, China
  • 3State Key Laboratory of Radio Frequency Heterogeneous Integration, College of Physics and Optoelectronic Engineering, Shenzhen University, Shenzhen 518060, China
  • 4School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China
  • 5School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore
  • 6School of Artificial Intelligence, Beijing Normal University, Beijing 100875, China
  • 7e-mail: liuxiangleiinrs@gmail.com
    • show less
    Full TextGet PDF
    Figures&Tables (11)
    Equations (14)
    Suppl.&Mat.
    References (61)
    Cited By (2)
    Tools
    Paper Information
    Topics
    References(61)

    [1] G. Lu, B. Fei. Medical hyperspectral imaging: a review. J. Biomed. Opt., 19, 010901(2014).

    [2] M. Manley. Near-infrared spectroscopy and hyperspectral imaging: non-destructive analysis of biological materials. Chem. Soc. Rev., 43, 8200-8214(2014).

    [3] Y. Zhao, S. Kusama, Y. Furutani. High-speed scanless entire bandwidth mid-infrared chemical imaging. Nat. Commun., 14, 3929(2023).

    [4] M. Zhang, W. Li, X. Zhao. Morphological transformation and spatial-logical aggregation for tree species classification using hyperspectral imagery. IEEE Trans. Geosci. Remote Sens., 61(2023).

    [5] W. Zhang, J. Suo, K. Dong. Handheld snapshot multi-spectral camera at tens-of-megapixel resolution. Nat. Commun., 14, 5043(2023).

    [6] L. M. Dale, A. Thewis, C. Boudry. Hyperspectral imaging applications in agriculture and agro-food product quality and safety control: a review. Appl. Spectrosc. Rev., 48, 142-159(2013).

    [7] V. Marx. When microbiologists plunge into the ocean. Nat. Methods, 17, 133-136(2020).

    [8] T. L. Pivert-Jolivet, R. Brunetto, C. Pilorget. Space weathering record and pristine state of Ryugu samples from MicrOmega spectral analysis. Nat. Astron, 7, 1445-1453(2023).

    [9] M. Shimoni, R. Haelterman, C. Perneel. Hypersectral imaging for military and security applications: combining myriad processing and sensing techniques. IEEE Geosci. Remote Sens. Mag., 7, 101-117(2019).

    [10] J. Peng, K. Yu, J. Wang. Mining painted cultural relic patterns based on principal component images selection and image fusion of hyperspectral images. J. Cult. Heritage, 36, 32-39(2019).

    [11] Z. Yang, T. Albrow-Owen, W. Cai. Miniaturization of optical spectrometers. Science, 371, eabe0722(2021).

    [12] L. Huang, R. Luo, X. Liu. Spectral imaging with deep learning. Light Sci. Appl., 11, 61(2022).

    [13] K. Monakhova, K. Yanny, N. Aggarwal. Spectral DiffuserCam: lensless snapshot hyperspectral imaging with a spectral filter array. Optica, 7, 1298-1307(2020).

    [14] G. R. Arce, D. J. Brady, L. Carin. Compressive coded aperture spectral imaging: an introduction. IEEE Signal Process Mag., 31, 105-115(2013).

    [15] J. Bacca, T. Gelvez-Barrera, H. Arguello. Deep coded aperture design: an end-to-end approach for computational imaging tasks. IEEE Trans. Comput. Imaging, 7, 1148-1160(2021).

    [16] X. Hua, Y. Wang, S. Wang. Ultra-compact snapshot spectral light-field imaging. Nat. Commun., 13, 2732(2022).

    [17] Y. Xu, L. Lu, V. Saragadam. A compressive hyperspectral video imaging system using a single-pixel detector. Nat. Commun., 15, 1456(2024).

    [18] Y. Peng, Q. Fu, W. Heidrich. The diffractive achromat full spectrum computational imaging with diffractive optics. SIGGRAPH ASIA 2016 Virtual Reality meets Physical Reality: Modelling and Simulating Virtual Humans and Environments, 1-2(2016).

    [19] Z. Zhou, Y. Zhang, Y. Xie. Electrically tunable planar liquid-crystal singlets for simultaneous spectrometry and imaging. Light Sci. Appl., 13, 242(2024).

    [20] H. Arguello, S. Pinilla, G. Wetzstein. Shift-variant color-coded diffractive spectral imaging system. Optica, 8, 1424-1434(2021).

    [21] F. S. Oktem, O. F. Kar, F. Kamalabadi. High-resolution multi-spectral imaging with diffractive lenses and learned reconstruction. IEEE Trans. Comput. Imaging, 7, 489-504(2021).

    [22] L. Wang, L. Li, W. Song. Non-serial quantization-aware deep optics for snapshot hyperspectral imaging. IEEE Trans. Pattern Anal. Mach. Intell., 46, 6993-7010(2024).

    [23] Q. Pian, R. Yao, X. Intes. Compressive hyperspectral time-resolved wide-field fluorescence lifetime imaging. Nat. Photonics, 11, 411-414(2017).

    [24] X. Yuan, D. J. Brady, A. K. Katsaggelos. Snapshot compressive imaging: theory, algorithms, and applications. IEEE Signal Process Mag., 38, 65-88(2021).

    [25] W. Zhang, H. Song, X. Liu. Deeply learned broadband encoding stochastic hyperspectral imaging. Light Sci. Appl., 10, 108(2021).

    [26] J. W. Goodman. Introduction to Fourier Optics(2005).

    [27] S. H. Baek, H. Ikoma, M. H. Kim. Single-shot hyperspectral-depth imaging with learned diffractive optics. IEEE/CVF International Conference on Computer Vision, 2651-2660(2021).

    [28] X. Dun, H. Ikoma, G. Wetzstein. Learned rotationally symmetric diffractive achromat for full-spectrum computational imaging. Optica, 7, 913-922(2020).

    [29] D. S. Jeon, S. H. Baek, M. H. Kim. Compact snapshot hyperspectral imaging with diffracted rotation. ACM Trans. Graph., 38, 117(2019).

    [30] C. A. Metzler, H. Ikoma, G. Wetzstein. Deep optics for single-shot high-dynamic-range imaging. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1375-1385(2020).

    [31] F. Yesilkoy, E. R. Arvelo, H. Altug. Ultrasensitive hyperspectral imaging and biodetection enabled by dielectric metasurfaces. Nat. Photonics, 13, 390-396(2019).

    [32] C. H. Lin, S. H. Huang, P. C. Wu. Metasurface-empowered snapshot hyperspectral imaging with convex/deep (CODE) small-data learning theory. Nat. Commun., 14, 6979(2023).

    [33] E. Tseng, S. Colburn, F. Heide. Neural nano-optics for high-quality thin lens imaging. Nat. Commun., 12, 6493(2021).

    [34] A. Arbabi, A. Faraon. Advances in optical metalenses. Nat. Photonics, 17, 16-25(2023).

    [35] W. J. Padilla, R. D. Averitt. Imaging with metamaterials. Nat. Rev. Phys., 4, 85-100(2022).

    [36] V. Sitzmann, S. Diamond, G. Wetzstein. End-to-end optimization of optics and image processing for achromatic extended depth of field and super-resolution imaging. ACM Trans. Graph., 37, 114(2018).

    [37] L. Huang, J. Whitehead, A. Majumdar. Design and analysis of extended depth of focus metalenses for achromatic computational imaging. Photon. Res., 8, 1613-1623(2020).

    [38] Y. Hu, Q. Cui, L. Zhao. PSF model for diffractive optical elements with improved imaging performance in dual-waveband infrared systems. Opt. Express, 26, 26845-26857(2018).

    [39] L. Li, L. Wang, W. Song. Quantization-aware deep optics for diffractive snapshot hyperspectral imaging. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 19780-19789(2022).

    [40] S. Mao, J. Zhao. Design and analysis of a hybrid optical system containing a multilayer diffractive optical element with improved diffraction efficiency. Appl. Opt., 59, 5888-5895(2020).

    [41] S. Banerji, J. Cooke, B. Sensale-Rodriguez. Impact of fabrication errors and refractive index on multilevel diffractive lens performance. Sci. Rep., 10, 14608(2020).

    [42] Q. Sun, J. Zhang, W. Heidrich. End-to-end learned, optically coded super-resolution SPAD camera. ACM Trans. Graph., 39, 9(2020).

    [43] F. Heide, Q. Fu, W. Heidrich. Encoded diffractive optics for full-spectrum computational imaging. Sci. Rep., 6, 33543(2016).

    [44] C. Zuo, J. Qian, Q. Chen. Deep learning in optical metrology: a review. Light Sci. Appl., 11, 39(2022).

    [45] X. Yuan, Y. Wang, L. Fang. Training large-scale optoelectronic neural networks with dual-neuron optical-artificial learning. Nat. Commun., 14, 7110(2023).

    [46] G. Wu, Y. Liu, L. Fang. Light field reconstruction using convolutional network on EPI and extended applications. IEEE Trans. Pattern Anal. Mach. Intell., 41, 1681-1694(2019).

    [47] O. Ronneberger, P. Fischer, T. Brox. U-Net: convolutional networks for biomedical image segmentation. 18th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 234-241(2015).

    [48] Z. Zhang, Q. Liu, Y. Wang. Road extraction by deep residual U-Net. IEEE Geosci. Remote Sens. Lett., 15, 749-753(2018).

    [49] J. Guan, R. Lai, H. Li. DnRCNN: deep recurrent convolutional neural network for HSI destriping. IEEE Trans. Neural Netw. Learn. Syst., 34, 3255-3268(2023).

    [50] Y. Liu, R. Dian, S. Li. Low-rank transformer for high-resolution hyperspectral computational imaging. Int. J. Comput. Vis., 1-16(2024).

    [51] X. Wang, Z. Huang, S. Zhang. GMSR: gradient-guided mamba for spectral reconstruction from RGB images. arXiv(2024).

    [52] N. Suchkov, E. J. Fernández, J. L. Martínez-Fuentes. Simultaneous aberration and aperture control using a single spatial light modulator. Opt. Express, 27, 12399-12413(2019).

    [53] B. Zhang, X. Yuan, J. Suo. End-to-end snapshot compressed super-resolution imaging with deep optics. Optica, 9, 451-454(2022).

    [54] J. Park, X. Feng, R. Liang. Snapshot multidimensional photography through active optical mapping. Nat. Commun., 11, 5602(2020).

    [55] S. Pinilla, J. E. Fröch, K. Egiazarian. Miniature color camera via flat hybrid meta-optics. Sci. Adv., 9, eadg7297(2023).

    [56] D. Wang, Y. L. Li, X. R. Zheng. Decimeter-depth and polarization addressable color 3D meta-holography. Nat. Commun., 15, 8242(2024).

    [57] D. Wang, N. N. Li, Y. L. Li. Large viewing angle holographic 3D display system based on maximum diffraction modulation. Light Adv. Manuf., 4, 195-205(2023).

    [58] B. Arad, O. Ben-Shahar. Sparse recovery of hyperspectral signal from natural RGB images. 14th European Conference on Computer Vision (ECCV), 19-34(2016).

    [59] J. Liang, F. Légaré, F. Calegari. Ultrafast imaging. Ultrafast Sci., 4, 0059(2024).

    [60] K. Zhang, L. V. Gool, R. Timofte. Deep unfolding network for image super-resolution. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3217-3226(2020).

    [61] K. Zhang, Y. Li, R. Timofte. Plug-and-play image restoration with deep denoiser prior. IEEE Trans. Pattern Anal. Mach. Intell., 44, 6360-6376(2021).

    Tools

    Get Citation

    Copy Citation Text

    Chong Zhang, Xianglei Liu, Lizhi Wang, Shining Ma, Yuanjin Zheng, Yue Liu, Hua Huang, Yongtian Wang, Weitao Song, "Lensless efficient snapshot hyperspectral imaging using dynamic phase modulation," Photonics Res. 13, 511 (2025)

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Set citation alerts for article
    Save article for my favorites
    Paper Information

    Category: Imaging Systems, Microscopy, and Displays

    Received: Oct. 7, 2024

    Accepted: Nov. 21, 2024

    Published Online: Feb. 10, 2025

    The Author Email: Weitao Song (swt@bit.edu.cn)

    DOI:10.1364/PRJ.543621

    CSTR:32188.14.PRJ.543621

    Topics

    laser devices and laser physics
    Lasers and Laser Optics
    Laser physics
    laser manufacturing
    Instrumentation, Measurement and Metrology