Researching | Single-Photon Imaging Algorithms Based on Multi-Scale Fusion Networks

Acta Optica Sinica, Volume. 45, Issue 10, 1011005(2025)

Single-Photon Imaging Algorithms Based on Multi-Scale Fusion Networks

Pengfei Zhou^1,2, Yuyang Zhao^1,2, Chenghao Jiang¹, Tianpeng Xie^1,2, Yan Jiang¹, Zhonghe Liu^1,2, and Jingguo Zhu^1、*

Author Affiliations

¹Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China

²University of Chinese Academy of Sciences, Beijing 100049, China

show less

Abstract Get PDF(in Chinese)

Figures&Tables (11)

References (33)

Paper Information

References(33)

[1] Andersson P. Long-range three-dimensional imaging using range-gated laser radar images[J]. Optical Engineering, 45, 034301(2006).

[2] Yang Y F, Yang K L. LiDAR detection and imaging algorithm in foggy environments[J]. Acta Optica Sinica, 45, 0611001(2025).

[3] Zuo H J, Yang Z X, Li X X et al. High-performance 40×30 single-photon avalanche diode dTOF sensor[J]. Acta Optica Sinica, 44, 2304001(2024).

[4] Liu B, Yu Y, Jiang S. Review of advances in LiDAR detection and 3D imaging[J]. Opto-Electronic Engineering, 46, 190167(2019).

[5] Zhao X C, Wu M, Zhang Y et al. Robust single-photon 3D imaging based on full-scale feature integration and intensity edge guidance[J]. Optics and Lasers in Engineering, 172, 107850(2024).

[6] Zhang H Y, Zhao X Y, Zhang Y C et al. Review of advances in single-photon LiDAR[J]. Chinese Journal of Lasers, 49, 1910003(2022).

[7] Zhao Y Y, Zhou P F, Xie T P et al. Development status and trends of single-photon LiDAR technology[J]. Opto-Electronic Engineering, 51, 240037(2024).

[8] Qian X Y, Jiang W, Deen M J. Single photon detectors for automotive LiDAR applications: state-of-the-art and research challenges[J]. IEEE Journal of Selected Topics in Quantum Electronics, 30, 3800520(2024).

[9] Chen Q Y, Xu T, Liu Z Q et al. LiDAR ranging system with integrated near-infrared SPAD array[J]. Acta Optica Sinica, 44, 1228001(2024).

[10] Li Z P, Ye J T, Huang X et al. Single-photon imaging over 200 km[J]. Optica, 8, 344-349(2021).

[11] Du B C, Pang C K, Wu D et al. High-speed photon-counting laser ranging for broad range of distances[J]. Scientific Reports, 8, 4198(2018).

[12] Hua K J, Liu B, Fang L et al. Correction of range walk error for underwater photon-counting imaging[J]. Optics Express, 28, 36260-36273(2020).

[13] Liu X T, Wang J Y, Xiao L P et al. Non-line-of-sight imaging with arbitrary illumination and detection pattern[J]. Nature Communications, 14, 3230(2023).

[14] Tu M, Yan Q R, Zheng Y J et al. Poisson noise suppression for single-photon non-line-of-sight imaging based on deep learning[J]. Laser & Optoelectronics Progress, 60, 2011003(2023).

[15] Shin D, Xu F H, Venkatraman D et al. Photon-efficient imaging with a single-photon camera[J]. Nature Communications, 7, 12046(2016).

[16] Rapp J, Goyal V K. A few photons among many: unmixing signal and noise for photon-efficient active imaging[J]. IEEE Transactions on Computational Imaging, 3, 445-459(2017).

[17] Lindell D B, O’Toole M, Wetzstein G. Single-photon 3D imaging with deep sensor fusion[J]. ACM Transactions on Graphics, 37, 113(2018).

[18] Peng J Y, Xiong Z W, Huang X et al. Photon-efficient 3D imaging with a non-local neural network[M]. Computer vision-ECCV 2020, 12351, 225-241(2020).

[19] Zhao X C, Jiang X D, Han A J et al. Photon-efficient 3D reconstruction employing a edge enhancement method[J]. Optics Express, 30, 1555-1569(2022).

[20] Yang X, Tong Z Y, Jiang P F et al. Deep-learning based photon-efficient 3D and reflectivity imaging with a 64×64 single-photon avalanche detector array[J]. Optics Express, 30, 32948-32964(2022).

[21] Li C H, Liu F, Wang X Q et al. Passive single-photon point target detection based on first-photon time[J]. Acta Optica Sinica, 44, 0911002(2024).

[22] Lee J, Ingle A, Chacko J V et al. CASPI: collaborative photon processing for active single-photon imaging[J]. Nature Communications, 14, 3158(2023).

[23] Li Y, Peng J Y, Ye J T et al. NLOST: non-line-of-sight imaging with transformer[C], 13313-13322(2023).

[24] Tan H, Peng J Y, Xiong Z W et al. Deep learning based single-photon 3D imaging with multiple returns[C], 1196-1205(2020).

[25] Zang Z Y, Xiao D, Day-Uei Li D. Non-fusion time-resolved depth image reconstruction using a highly efficient neural network architecture[J]. Optics Express, 29, 19278-19291(2021).

[26] Ronneberger O, Fischer P, Brox T. U-Net: convolutional networks for biomedical image segmentation[M]. Medical image computing and computer-assisted intervention-MICCAI 2015, 9351, 234-241(2015).

[27] Heo B, Yun S, Han D et al. Rethinking spatial dimensions of vision transformers[C], 11916-11925(2021).

[28] Shi Z, Chen C, Xiong Z W et al. HSCNN: advanced CNN-based hyperspectral recovery from RGB images[C], 10521-10528(2018).

[29] Woo S, Park J, Lee J Y et al. CBAM: convolutional block attention module[M]. Computer vision-ECCV 2018, 11211, 3-19(2018).

[30] Silberman N, Hoiem D, Kohli P et al. Indoor segmentation and support inference from RGBD images[M]. Computer vision-ECCV 2012, 7576, 746-760(2012).

[31] Harmany Z T, Marcia R F, Willett R M. This is SPIRAL-TAP: sparse Poisson intensity reconstruction algorithms: theory and practice[J]. IEEE Transactions on Image Processing, 21, 1084-1096(2012).

[32] Sun Z H, Lindell D B, Solgaard O et al. SPADnet: deep RGB-SPAD sensor fusion assisted by monocular depth estimation[J]. Optics Express, 28, 14948-14962(2020).

[33] Scharstein D, Szeliski R, Zabih R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms[C], 131-140(2001).

Tools

Get Citation

Copy Citation Text

Pengfei Zhou, Yuyang Zhao, Chenghao Jiang, Tianpeng Xie, Yan Jiang, Zhonghe Liu, Jingguo Zhu. Single-Photon Imaging Algorithms Based on Multi-Scale Fusion Networks[J]. Acta Optica Sinica, 2025, 45(10): 1011005

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Imaging Systems

Received: Jan. 24, 2025

Accepted: Apr. 2, 2025

Published Online: May. 19, 2025

The Author Email: Jingguo Zhu (zhujingguo@ime.ac.cn)

DOI:10.3788/AOS250542

CSTR:32393.14.AOS250542

Topics

laser devices and laser physics

Lasers and Laser Optics

laser manufacturing

Instrumentation, Measurement and Metrology