Multifunctional Applications and Technological Progresses of Lensless Computational Optical Imaging (Invited)

Tailong Xiao; Ze Zheng; Guihua Zeng

doi:10.3788/LOP251014

Laser & Optoelectronics Progress, Volume. 62, Issue 17, 1739016(2025)

Multifunctional Applications and Technological Progresses of Lensless Computational Optical Imaging (Invited)

Tailong Xiao^1,2,3、*, Ze Zheng¹, and Guihua Zeng^1,2,3、**

¹Institute for Quantum Sensing and Information Processing, State Key Laboratory of Photonics and Communications, Shanghai Jiao Tong University, Shanghai 200240, China

²Shanghai Research Center for Quantum Sciences, Shanghai 201315, China

³Hefei National Laboratory, Hefei 230088, Anhui , China

show less

Abstract Get PDF(in Chinese)

References(127)

[1] Russell A P, Monnet G, Quirrenbach A et al. Instruments for a European extremely large telescope: the challenges of designing instruments for 30- to 100-m telescopes[J]. Proceedings of SPIE, 5492, 1796-1809(2004).

[2] Spanò P, Zerbi F M, Norrie C J et al. Challenges in optics for extremely large telescope instrumentation[J]. Astronomische Nachrichten, 327, 649-673(2006).

[3] Pirati A, Peeters R, Smith D et al. EUV lithography performance for manufacturing: status and outlook[J]. Proceedings of SPIE, 9776, 97760A(2016).

[4] Wang Y Y, Chi M H, Lou J J C et al[M]. Handbook of integrated circuit industry(2024).

[5] Song J Q, Liu B L, Shan X C et al. Multi-functional dual-path self-aligned polarization interference lithography[J]. Optics Express, 31, 17629-17644(2023).

[6] Boominathan V, Robinson J T, Waller L et al. Recent advances in lensless imaging[J]. Optica, 9, 1-16(2022).

[7] Wang Y, Duan Z J. Advances in mask-modulated lensless imaging[J]. Electronics, 13, 617(2024).

[8] Li S W, Gao Y H, Wu J C et al. Lensless camera: unraveling the breakthroughs and prospects[J]. Fundamental Research, 5, 1725-1736(2025).

[9] Elmalem S, Giryes R. A lensless polarization camera[C], CTh7A.1(2021).

[10] Li Y T, Wei S L, Li Z et al. Hyperspectral imaging through scattering layers with incoherent light[J]. Applied Physics Letters, 120, 101101(2022).

[11] Liu Y H, Qin T X, Wang Y C et al. Research advances in simple and compact optical imaging techniques[J]. Acta Physica Sinica, 72, 084205(2023).

[12] Tian M H, Liu B L, Lu Z L et al. Miniaturized on-chip spectrometer enabled by electrochromic modulation[J]. Light: Science & Applications, 13, 278(2024).

[13] Zhang X, Wang B W, Li S et al. Lensless imaging with a programmable Fresnel zone aperture[J]. Science Advances, 11, eadt3909(2025).

[14] Adams J K, Yan D, Wu J M et al. In vivo lensless microscopy via a phase mask generating diffraction patterns with high-contrast contours[J]. Nature Biomedical Engineering, 6, 617-628(2022).

[15] Wu J M, Chen Y Z, Veeraraghavan A et al. Mesoscopic calcium imaging in a head-unrestrained male non-human primate using a lensless microscope[J]. Nature Communications, 15, 1271(2024).

[16] Baek N, Lee Y J, Kim T et al. Lensless polarization camera for single-shot full-Stokes imaging[J]. APL Photonics, 7, 116107(2022).

[17] Shimano T, Nakamura Y, Tajima K et al. Lensless light-field imaging with Fresnel zone aperture: quasi-coherent coding[J]. Applied Optics, 57, 2841-2850(2018).

[18] Ozcan A, Demirci U. Ultra wide-field lens-free monitoring of cells on-chip[J]. Lab on a Chip, 8, 98-106(2008).

[19] Wang Y, Liu B L, Ding L et al. Multi-photon super-linear image scanning microscopy using upconversion nanoparticles[J]. Laser & Photonics Reviews, 18, 2400746(2024).

[20] Liu B L, Wang Y, Song J Q et al. Structured illumination super-resolution imaging with lanthanide-doped upconversion nanoparticles[J]. Proceedings of SPIE, 12975, 129750S(2023).

[21] Zheng G A, Lee S A, Yang S et al. Sub-pixel resolving optofluidic microscope for on-chip cell imaging[J]. Lab on a Chip, 10, 3125-3129(2010).

[22] Luo W, Greenbaum A, Zhang Y B et al. Synthetic aperture-based on-chip microscopy[J]. Light: Science & Applications, 4, e261(2015).

[23] Li Y L, Ma J S, Cao L C et al. Super-resolution lensless on-chip microscopy based on array illumination and sub-pixel shift search[J]. Optics Letters, 49, 1620-1623(2024).

[24] Liu Y Y, Liu Q W, Li Y et al. High-resolution multi-wavelength lensless diffraction imaging with adaptive dispersion correction[J]. Optics Express, 29, 7197-7209(2021).

[25] Wu X J, Sun J S, Chen Y et al. Wavelength-scanning pixel-super-resolved lens-free on-chip quantitative phase microscopy with a color image sensor[J]. APL Photonics, 9, 016111(2024).

[26] Chang X Y, Jiang S W, Hu Y C et al. Pixel super-resolved lensless on-chip sensor with scattering multiplexing[J]. ACS Photonics, 10, 2323-2331(2023).

[27] Chen X Y, Sha H, Chen C Y et al. Adaptive lensless microscopic imaging with unknown phase modulation[J]. Biomedical Optics Express, 16, 1160-1171(2025).

[28] Wu X J, Sun J S, Zhang J L et al. Wavelength-scanning lensfree on-chip microscopy for wide-field pixel-super-resolved quantitative phase imaging[J]. Optics Letters, 46, 2023-2026(2021).

[29] Wu X J, Zhou N, Chen Y et al. Lens-free on-chip 3D microscopy based on wavelength-scanning Fourier ptychographic diffraction tomography[J]. Light: Science & Applications, 13, 237(2024).

[30] Chen Y, Wu X J, Lu L P et al. Pixel-super-resolved lens-free quantitative phase microscopy with partially coherent illumination[J]. NPJ Nanophotonics, 1, 15(2024).

[31] Yang L M, Wang R H, Zhao Q H et al. Lensless polarimetric coded ptychography for high-resolution, high-throughput gigapixel birefringence imaging on a chip[J]. Photonics Research, 11, 2242-2255(2023).

[32] Zhou Y, Song W Z, Wu L Y et al. Large-scale lensless microscopy with fast acquisition and region-wise focusing[J]. Laser & Photonics Reviews, 18, 2400498(2024).

[33] Tian Z Q, Li L N, Ma J S et al. CFZA camera: a high-resolution lensless imaging technique based on compound Fresnel zone aperture[J]. Optics Letters, 49, 3532-3535(2024).

[34] Tang Y H, Zhao B, Ye X Y et al. Lensless fiber endomicroscopic phase imaging using a physical model-driven neural network[J]. Optics Express, 33, 10951-10964(2025).

[35] Boominathan V, Adams J K, Robinson J T et al. PhlatCam: designed phase-mask based thin lensless camera[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42, 1618-1629(2020).

[36] Liu F L, Kuo G, Antipa N et al. Fourier DiffuserScope: single-shot 3D Fourier light field microscopy with a diffuser[J]. Optics Express, 28, 28969-28986(2020).

[37] He K, Wang X L, Wang Z W et al. Snapshot multifocal light field microscopy[J]. Optics Express, 28, 12108-12120(2020).

[38] Asif M S, Ayremlou A, Sankaranarayanan A et al. FlatCam: thin, lensless cameras using coded aperture and computation[J]. IEEE Transactions on Computational Imaging, 3, 384-397(2017).

[39] Seow K L C, Török P, Foreman M R. Single pixel polarimetric imaging through scattering media[J]. Optics Letters, 45, 5740-5743(2020).

[40] Tian M H, Liu B L, Zheng Z et al. Polarization-responsive filters for miniaturized on-chip spectrometer[J]. Proceedings of SPIE, 12975, 129750U(2023).

[41] Zheng Z, Liu B L, Tian M H et al. Spectral and polarization imaging by a lensless diffuser camera[J]. Proceedings of SPIE, 12975, 129750R(2023).

[42] Ma R, Luo K H, Pokharel S et al. Orbital-angular-momentum-dependent speckles for spatial mode sorting and demultiplexing[J]. Optica, 11, 595-605(2024).

[43] Ye Z Y, Ding C X, Zhao J L et al. Vortex memory effect of light for scattering-assisted massive data transmission[J]. Optica, 12, 281-295(2025).

[44] Yako M, Yamaoka Y, Kiyohara T et al. Video-rate hyperspectral camera based on a CMOS-compatible random array of Fabry-Pérot filters[J]. Nature Photonics, 17, 218-223(2023).

[45] Lei Y S, Zhang Q, Guo Y H et al. Snapshot multi-dimensional computational imaging through a liquid crystal diffuser[J]. Photonics Research, 11, B111-B124(2023).

[46] Zheng Z, Liu B L, Song J Q et al. Temporal compressive edge imaging enabled by a lensless diffuser camera[J]. Optics Letters, 49, 3058-3061(2024).

[47] Malone J D, Aggarwal N, Waller L et al. DiffuserSpec: spectroscopy with Scotch tape[J]. Optics Letters, 48, 323-326(2023).

[48] Cai Z W, Chen J W, Pedrini G et al. Lensless light-field imaging through diffuser encoding[J]. Light: Science & Applications, 9, 143(2020).

[49] Antipa N, Kuo G, Heckel R et al. DiffuserCam: lensless single-exposure 3D imaging[J]. Optica, 5, 1-9(2018).

[50] Monakhova K, Yanny K, Aggarwal N et al. Spectral DiffuserCam: lensless snapshot hyperspectral imaging with a spectral filter array[J]. Optica, 7, 1298-1307(2020).

[51] Liu F Y, Wu J C, Cao L C. Autofocusing of Fresnel zone aperture lensless imaging for QR code recognition[J]. Optics Express, 31, 15889-15903(2023).

[52] Wu J C, Cao L C, Barbastathis G. DNN-FZA camera: a deep learning approach toward broadband FZA lensless imaging[J]. Optics Letters, 46, 130-133(2021).

[53] Wu J C, Zhang H, Zhang W H et al. Single-shot lensless imaging with Fresnel zone aperture and incoherent illumination[J]. Light: Science & Applications, 9, 53(2020).

[54] Li L N, Ma J S, Sun D et al. Amp-vortex edge-camera: a lensless multi-modality imaging system with edge enhancement[J]. Optics Express, 31, 22519-22531(2023).

[55] Sahoo S K, Tang D L, Dang C. Single-shot multispectral imaging with a monochromatic camera[J]. Optica, 4, 1209-1213(2017).

[56] Pierangeli D, Volpe G, Conti C. Deep learning enabled transmission of full-Stokes polarization images through complex media[J]. Laser & Photonics Reviews, 18, 2400626(2024).

[57] Dong X, Xiang M, Lan Y B et al. Three-channel-switchable coded aperture snapshot multispectral polarization imaging[J]. Optics Letters, 49, 6681-6684(2024).

[58] Weinberg G, Katz O. 100,000 frames-per-second compressive imaging with a conventional rolling-shutter camera by random point-spread-function engineering[J]. Optics Express, 28, 30616-30625(2020).

[59] Antipa N, Oare P, Bostan E et al. Video from stills: lensless imaging with rolling shutter[C], 1-8(2019).

[60] Liu B L, Wang F, Chen C H et al. Single-pixel diffuser camera[J]. IEEE Photonics Journal, 13, 7800205(2021).

[61] Yanny K, Monakhova K, Shuai R W et al. Deep learning for fast spatially varying deconvolution[J]. Optica, 9, 96-99(2022).

[62] Khan S S, Sundar V, Boominathan V et al. FlatNet: towards photorealistic scene reconstruction from lensless measurements[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 1934-1948(2022).

[63] Hua X, Wang Y J, Wang S M et al. Ultra-compact snapshot spectral light-field imaging[J]. Nature Communications, 13, 2732(2022).

[64] Shen Z C, Zhao F, Jin C Q et al. Monocular metasurface camera for passive single-shot 4D imaging[J]. Nature Communications, 14, 1035(2023).

[65] Li X M, Wang Y, Shi J L et al. Large-area near-infrared emission enhancement on single upconversion nanoparticles by metal nanohole array[J]. Nano Letters, 24, 5831-5837(2024).

[66] Miller J R, Wang C Y, Keating C D et al. Particle-based reconfigurable scattering masks for lensless imaging[J]. ACS Nano, 14, 13038-13046(2020).

[67] Zheng Y C, Hua Y, Sankaranarayanan A C et al. A simple framework for 3D lensless imaging with programmable masks[C], 2583-2592(2021).

[68] Zhang C, Liu X L, Wang L Z et al. Lensless efficient snapshot hyperspectral imaging using dynamic phase modulation[J]. Photonics Research, 13, 511-526(2025).

[69] Hua Y, Nakamura S, Asif M S et al. SweepCam: depth-aware lensless imaging using programmable masks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42, 1606-1617(2020).

[70] Chen W, Chen X D. Structured-illumination-based lensless diffractive imaging and its application to optical image encryption[J]. Optics Communications, 285, 2044-2047(2012).

[71] Tan J, Niu L, Adams J K et al. Face detection and verification using lensless cameras[J]. IEEE Transactions on Computational Imaging, 5, 180-194(2019).

[72] Lin Z, Pestourie R, Roques-Carmes C et al. End-to-end metasurface inverse design for single-shot multi-channel imaging[J]. Optics Express, 30, 28358-28370(2022).

[73] Li Y G, Sun S, Lin H Z et al. Morphology and statistics of wide-spectrum speckles[J]. Optics Express, 30, 874-886(2022).

[74] Sun S, Nie Z W, Du L K et al. Overcoming the diffraction limit by exploiting unmeasured scattering media[J]. Optica, 11, 385-391(2024).

[75] Cheremkhin P A, Evtikhiev N N, Krasnov V V et al. Lensless optical encryption with speckle-noise suppression and QR codes[J]. Applied Optics, 60, 7336-7345(2021).

[76] Chen L F, Zhao D M. Optical color image encryption by wavelength multiplexing and lensless Fresnel transform holograms[J]. Optics Express, 14, 8552-8560(2006).

[77] Bian L H, Chang X Y, Jiang S W et al. Large-scale scattering-augmented optical encryption[J]. Nature Communications, 15, 9807(2024).

[78] Khan S S, Yu X, Mitra K et al. OpEnCam: lensless optical encryption camera[J]. IEEE Transactions on Computational Imaging, 10, 1306-1316(2024).

[79] Ge H Y, Feng Q, Jia H L et al. LPSNet: end-to-end human pose and shape estimation with lensless imaging[C], 1471-1480(2024).

[80] Zhang J C, Zeng H J, Cao J Z et al. Dual prior unfolding for snapshot compressive imaging[C], 25742-25752(2024).

[81] Yu Z P, Li H H, Zhao W N et al. High-security learning-based optical encryption assisted by disordered metasurface[J]. Nature Communications, 15, 2607(2024).

[82] Zheng P X, Dai Q, Li Z L et al. Metasurface-based key for computational imaging encryption[J]. Science Advances, 7, eabg0363(2021).

[83] Bhattarai S, Paudel P, Li Z et al. Robust privacy-preserving classification for lensless images[C], 371-379(2024).

[84] Llull P, Liao X J, Yuan X et al. Coded aperture compressive temporal imaging[J]. Optics Express, 21, 10526-10545(2013).

[85] Sun J Q, Su Y D, Zhang H et al. SnapCap: efficient snapshot compressive scene captioning[J]. Advanced Imaging, 2, 011003(2025).

[86] Liu Y, Yuan X, Suo J L et al. Rank minimization for snapshot compressive imaging[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41, 2990-3006(2019).

[87] Cao X, Yue T, Lin X et al. Computational snapshot multispectral cameras: toward dynamic capture of the spectral world[J]. IEEE Signal Processing Magazine, 33, 95-108(2016).

[88] Chen Z Y, Zheng S M, Tong Z S et al. Physics-driven deep learning enables temporal compressive coherent diffraction imaging[J]. Optica, 9, 677-680(2022).

[89] Song J Q, Liu B L, Wang Y et al. Computational and dark-field ghost imaging with ultraviolet light[J]. Photonics Research, 12, 226-234(2024).

[90] Sun Z B, Ma H Q, Lei M et al. Single-photon detection at telecom wavelengths[J]. Chinese Physics Letters, 24, 574(2007).

[91] Zhang A X, He Y H, Wu L A et al. Tabletop X-ray ghost imaging with ultra-low radiation[J]. Optica, 5, 374-377(2018).

[92] Olivieri L, Gongora J S T, Peters L et al. Hyperspectral terahertz microscopy via nonlinear ghost imaging[J]. Optica, 7, 186-191(2020).

[93] He Y H, Huang Y Y, Zeng Z R et al. Single-pixel imaging with neutrons[J]. Science Bulletin, 66, 133-138(2021).

[94] Chen X H, Liu Q, Luo K H et al. Lensless ghost imaging with true thermal light[J]. Optics Letters, 34, 695-697(2009).

[95] Liu X F, Chen X H, Yao X R et al. Lensless ghost imaging with sunlight[J]. Optics Letters, 39, 2314-2317(2014).

[96] Liu X L, Shi J H, Wu X Y et al. Fast first-photon ghost imaging[J]. Scientific Reports, 8, 5012(2018).

[97] Liu X L, Shi J H, Sun L et al. Photon-limited single-pixel imaging[J]. Optics Express, 28, 8132-8144(2020).

[98] Liu B L, Wang F, Chen C H et al. Self-evolving ghost imaging[J]. Optica, 8, 1340-1349(2021).

[99] Liu B L, Yang Z H, Liu X et al. Coloured computational imaging with single-pixel detectors based on a 2D discrete cosine transform[J]. Journal of Modern Optics, 64, 259-264(2017).

[100] Wang D J, Liu B L, Song J Q et al. Dual-mode adaptive-SVD ghost imaging[J]. Optics Express, 31, 14225-14239(2023).

[101] Jiang W J, Yin Y K, Jiao J P et al. 2,000,‍000 fps 2D and 3D imaging of periodic or reproducible scenes with single-pixel detectors[J]. Photonics Research, 10, 2157-2164(2022).

[102] Sun M J, Zhang Y C, Lin F R et al. Rapid fluorescence lifetime imaging microscopy via few-photon imaging[J]. APL Photonics, 9, 016108(2024).

[103] Gao Z Q, Wu X Y, Zhai X L et al. Physics-informed two-stage neural network enables computational ghost imaging through unknown scattering media[EB/OL]. https://doi.org/10.1364/opticaopen.29155607.v1

[104] Wang F, Wang C L, Chen M L et al. Far-field super-resolution ghost imaging with a deep neural network constraint[J]. Light: Science & Applications, 11, 1(2022).

[105] Xiao T L, Zhai X L, Wu X Y et al. Practical advantage of quantum machine learning in ghost imaging[J]. Communications Physics, 6, 171(2023).

[106] Xiao T L, Zhai X L, Huang J Z et al. Quantum deep generative prior with programmable quantum circuits[J]. Communications Physics, 7, 276(2024).

[107] Zhai X L, Xiao T L, Huang J Z et al. Quantum neural compressive sensing for ghost imaging[J]. Physical Review Applied, 23, 014018(2025).

[108] Chien T, Cao R M, Liu F L et al. Space-time reconstruction for lensless imaging using implicit neural representations[J]. Optics Express, 32, 35725-35732(2024).

[109] Monakhova K, Tran V, Kuo G et al. Untrained networks for compressive lensless photography[J]. Optics Express, 29, 20913-20929(2021).

[110] Monakhova K, Yurtsever J, Kuo G et al. Learned reconstructions for practical mask-based lensless imaging[J]. Optics Express, 27, 28075-28090(2019).

[111] Poudel A, Nakarmi U. DeepLIR: attention-based approach for mask-based lensless image reconstruction[C], 431-439(2024).

[112] Sinha A, Lee J, Li S et al. Lensless computational imaging through deep learning[J]. Optica, 4, 1117-1125(2017).

[113] Lyu M, Wang H, Li G W et al. Learning-based lensless imaging through optically thick scattering media[J]. Advanced Photonics, 1, 036002(2019).

[114] Zuo J L, Tang J, Zhang M M et al. Lensless imaging based on dual-input physics-driven neural network[J]. Advanced Photonics Research, 5, 2400029(2024).

[115] Cao R M, Divekar N S, Nuñez J K et al. Neural space-time model for dynamic multi-shot imaging[J]. Nature Methods, 21, 2336-2341(2024).

[116] Lin X, Rivenson Y, Yardimci N T et al. All-optical machine learning using diffractive deep neural networks[J]. Science, 361, 1004-1008(2018).

[117] Luo Y, Zhao Y F, Li J X et al. Computational imaging without a computer: seeing through random diffusers at the speed of light[J]. eLight, 2, 4(2022).

[118] Zhang Y C, Zhang Q M, Yu H Y et al. Memory-less scattering imaging with ultrafast convolutional optical neural networks[J]. Science Advances, 10, eadn2205(2024).

[119] Bai B J, Lee R, Li Y H et al. Information-hiding cameras: optical concealment of object information into ordinary images[J]. Science Advances, 10, eadn9420(2024).

[120] Hu J T, Liao K, Dinç N U et al. Subwavelength imaging using a solid-immersion diffractive optical processor[J]. eLight, 4, 8(2024).

[121] Li Y H, Gan T Y, Bai B J et al. Optical information transfer through random unknown diffusers using electronic encoding and diffractive decoding[J]. Advanced Photonics, 5, 046009(2023).

[122] Li Y H, Luo Y, Mengu D et al. Quantitative phase imaging (QPI) through random diffusers using a diffractive optical network[J]. Light: Advanced Manufacturing, 4, 206-221(2023).

[123] Mengu D, Tabassum A, Jarrahi M et al. Snapshot multispectral imaging using a diffractive optical network[J]. Light: Science & Applications, 12, 86(2023).

[124] Li J X, Gan T Y, Zhao Y F et al. Unidirectional imaging using deep learning-designed materials[J]. Science Advances, 9, eadg1505(2023).

[125] Yu H Y, Huang Z H, Lamon S et al. All-optical image transportation through a multimode fibre using a miniaturized diffractive neural network on the distal facet[J]. Nature Photonics, 19, 486-493(2025).

[126] Luo X Y, Wang S, Liu J P et al. Revolutionizing optical imaging: computational imaging via deep learning[J]. Photonics Insights, 4, R03(2025).

[127] Xu D L, Ma Y C, Jin G F et al. Intelligent photonics: a disruptive technology to shape the present and redefine the future[J]. Engineering, 46, 186-213(2025).

Tools

Get Citation

Copy Citation Text

Tailong Xiao, Ze Zheng, Guihua Zeng. Multifunctional Applications and Technological Progresses of Lensless Computational Optical Imaging (Invited)[J]. Laser & Optoelectronics Progress, 2025, 62(17): 1739016

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: AI for Optics

Received: Apr. 16, 2025

Accepted: Jun. 19, 2025

Published Online: Sep. 11, 2025

The Author Email: Tailong Xiao (tailong_shaw@sjtu.edu.cn), Guihua Zeng (ghzeng@sjtu.edu.cn)

DOI:10.3788/LOP251014

CSTR:32186.14.LOP251014

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology