Infrared and Laser Engineering, Volume. 51, Issue 8, 20220231(2022)

Overview of efficient single-pixel sensing methods

Liheng Bian1、*, Xinrui Zhan1, Huayi Wang1, Haiyan Liu1, and Jinli Suo2、*
Author Affiliations
  • 1Advanced Research Institute of Multidisciplinary Science & School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China
  • 2Department of Automation, Tsinghua University, Beijing 100084, China
  • show less
    References(107)

    [1] Ma J. A single-pixel imaging system for remote sensing by two-step iterative curvelet thresholding[J]. IEEE Geoscience and Remote Sensing Letters, 6, 676-680(2009).

    [2] Ma J. Single-pixel remote sensing[J]. IEEE Geoscience and Remote Sensing Letters, 6, 199-203(2009).

    [3] Llull P, Liao X, Yuan X, et al. Coded aperture compressive temporal imaging[J]. Optics Express, 21, 10526-10545(2013).

    [4] [4] Yuan X, Llull P, Liao X, et al. Lowcost compressive sensing f col video depth[C]IEEE Conference on Computer Vision Pattern Recognition, 2014: 33183325.

    [5] [5] Yuan X, Liu Y, Suo J, et al. Plugplay algithms f largescale snapshot compressive imaging[C]IEEECVF Conference on Computer Vision Pattern Recognition, 2020: 14471457.

    [6] Gariepy G, Tonolini F, Henderson R, et al. Detection and tracking of moving objects hidden from view[J]. Nature Photonics, 10, 23-26(2016).

    [7] Ashwin A, Wagadarikar, Nikos P, et al. Video rate spectral imaging using a coded aperture snapshot spectral imager[J]. Optics Express, 17, 6368-6388(2009).

    [8] Lin X, Liu Y, Wu J, et al. Spatial-spectral encoded compressive hyperspectral imaging[J]. ACM Transactions on Graphics (TOG), 33, 1-11(2014).

    [9] Shao X, Su Y, Liu J, et al. The connotation and system of computational imaging[J]. Acta Photonica Sinica, 50, 0511001(2021).

    [10] Shao X, Liu F, Li W, et al. Review of computational imaging technology and applications[J]. Laser & Optoelectronics Progress, 57, 020001(2020).

    [11] Huang W, Jiao S, Xiao C. A review of image processing algorithms related to single-pixel imaging[J]. Laser & Optoelectronics Progress, 58, 267-284(2021).

    [12] [12] Baird J L. Apparatus f transmitting views images to a distance: US Patent, 1,699,270[P]. 19290115. https:encrypted.google.compatentsUS1699270.

    [13] Bromberg Y, Katz O, Silberberg Y. Ghost imaging with a single detector[J]. Physical Review A, 79, 053840(2009).

    [14] Sen P, Chen B, Garg G, et al. Dual photography[J]. ACM Transactions on Graphics, 24, 745-755(2005).

    [15] Bian L, Suo J, Dai Q, et al. Experimental comparison of single-pixel imaging algorithms[J]. JOSA A, 35, 78-87(2018).

    [16] Bian L, Suo J, Situ G, et al. Multispectral imaging using a single bucket detector[J]. Scientific Reports, 6, 24752(2016).

    [17] Wang Y, Suo J, Fan J, et al. Hyperspectral computational ghost imaging via temporal multiplexing[J]. IEEE Photonics Technology Letters, 28, 288-291(2015).

    [18] Li Z, Suo J, Hu X, et al. Efficient single-pixel multispectral imaging via non-mechanical spatio-spectral modulation[J]. Scientific Reports, 7, 1-7(2017).

    [19] Bian L, Suo J, Chung J, et al. Fourier ptychographic reconstruction using Poisson maximum likelihood and truncated Wirtinger gradient[J]. Scientific Reports, 6, 27384(2016).

    [20] Bian L, Suo J, Hu X, et al. Efficient single-pixel imaging in Fourier space[J]. Journal of Optics, 18, 085704(2016).

    [21] Han S, Wu L, You L. Single-photon and single-pixel imaging special topic—foreword[J]. Laser & Optoelectronics Progress, 58, 1011000(2021).

    [22] [22] Zheng Y. Research on edge detection based on singlepixel imaging [D]. Xi''an: Xi''an University of Technology, 2021. (in Chinese)

    [23] Graham M G, Steven D J, Miles J P. Single-pixel imaging 12 years on: A review[J]. Optics Express, 28, 28190-28208(2020).

    [24] Pittman T B, Shih Y H, Strekalov D V, et al. Optical imaging by means of two-photon quantum entanglement[J]. Physical Review A, 52, R3429-R3432(1995).

    [25] Bennink R S, Bentley S J, Boyd R W. "Two-photon" coincidence imaging with a classical source[J]. Physical Review Letters, 89, 113601(2002).

    [26] Sun M J, Edgar M P, Gibson G M, et al. Single-pixel three-dimensional imaging with time-based depth resolution[J]. Nature Communications, 7, 1-6(2016).

    [27] Wang H, Bian L, Zhang J. Depth acquisition in single-pixel imaging with multiplexed illumination[J]. Optics Express, 29, 4866-4874(2021).

    [28] Cande`s E, Romberg J. Sparsity and incoherence in compressive sampling[J]. Inverse Problems, 23, 969-985(2007).

    [29] Duarte M F, Davenport M A, Takbar D, et al. Single-pixel imaging via compressive sampling[J]. IEEE Signal Processing Magazine, 25, 83-89(2008).

    [30] Shapiro J H. Computational ghost imaging[J]. Phyical Review A, 78, 061802(2008).

    [31] Shi D, Huang J, Wang F, et al. Enhancing resolution of single-pixel imaging system[J]. Optical Review, 22, 802-808(2015).

    [32] Pradeep S. On the relationship between dual photography and classical ghost imaging[J]. arXiv, 1309.3007(2013).

    [33] Phillips D B, Sun M J, Taylor J M, et al. Adaptive foveated single-pixel imaging with dynamic supersampling[J]. Science Advances, 3, e1601782(2017).

    [34] Zhai X, Cheng Z, Chen Y, et al. Foveated ghost imaging based on deep learning[J]. Optics Communications, 448, 69-75(2019).

    [35] Cao J, Zhou D, Zhang Y, et al. Optimization of retina-like illumination patterns in ghost imaging[J]. Optics Express, 29, 36813-36827(2021).

    [36] Mahalanobis A, Muise R. Object specific image reconstruction using a compressive sensing architecture for application in surveillance systems[J]. IEEE Transactions on Aerospace and Electronic Systems, 45, 1167-1180(2009).

    [37] Bian L, Wang H, Zhu C, et al. Image-free multi-character recognition[J]. Optics Letters, 47, 1343-1346(2022).

    [38] Fu H, Bian L, Zhang J. Single-pixel sensing with optimal binarized modulation[J]. Optics Letters, 45, 3111-3114(2020).

    [39] Zhai X, Wu X, Sun Y, et al. Theory and approach of single-pixel imaging (Invited)[J]. Infrared and Laser Engineering, 50, 2021106(2021).

    [40] Zhai Y H, Chen X H, Zhang D, et al. Two-photon interference with true thermal light[J]. Physical Review A, 72, 043805(2005).

    [41] [41] Davenpt M A, Duarte M F , Wakin M B , et al. The smashed filter f compressive classification target recognition[C]Proceedings of SPIE, 2007, 6498: 64980H.

    [42] [42] Lohit S, Kulkarni K, Turaga P, et al. Reconstructionfree inference on compressive measurements[C]IEEE Conference on Computer Vision Pattern Recognition Wkshops, 2015: 1624.

    [43] Kulkarni K, Turaga P. Reconstruction-free action inference from compressive imagers[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 772-784(2015).

    [44] Wei M, Xing F, You Z. A real-time detection and positioning method for small and weak targets using a 1D morphology-based approach in 2D images[J]. Light: Sci Appl, 7, 18006(2018).

    [45] Ye Hualong, Zhang Leihong, Zhang Dawei. Non-imaging target recognition algorithm based on projection matrix and image Euclidean distance by computational ghost imaging[J]. Optics & Laser Technology, 137, 106779(2021).

    [46] Zhao Y, Wang S, Zhang X, et al. Robust hashing for image authentication using zernike moments and local features[J]. IEEE Transactions on Information Forensics & Security, 8, 55-63(2013).

    [47] [47] Rizvi S, Cao J, Hao Q. Highspeed imagefree target detection classification in singlepixel imaging[C]SPIE Future Sensing Technologies, International Society f Optics Photonics, 2020, 11525: 115250 X.

    [48] Pan X, Chen X, Nakamura T, et al. Incoherent reconstruction-free object recognition with mask-based lensless optics and the Transformer[J]. Optics Express, 29, 37962-37978(2021).

    [49] Zhu Y, Shi J, Wu X, et al. Photon-limited non-imaging object detection and classification based on single-pixel imaging system[J]. Applied Physics B, 126, 1-8(2020).

    [50] [50] Pratt W K, Kane J, rews H C. Hadamard transfm image coding [C]Proceedings of the IEEE, 1969, 57(1): 5868.

    [51] [51] Lohit S, Kulkarni K, Turaga P. Direct inference on compressive measurements using convolutional neural wks[C]2016 IEEE International Conference on Image Processing (ICIP), IEEE, 2016: 19131917.

    [52] Latorre-Carmona P, Traver V J, Sánchez J S, et al. Online reconstruction-free single-pixel image classification[J]. Image and Vision Computing, 86, 28-37(2019).

    [53] Shi D, Yin K, Huang J, et al. Fast tracking of moving objects using single-pixel imaging[J]. Optics Communications, 440, 155-162(2019).

    [54] Jiao S, Feng J, Gao Y, et al. Optical machine learning with incoherent light and a single-pixel detector[J]. Opt Lett, 44, 5186-5189(2019).

    [55] Kravets V, Javidi B, Stern A. Compressive imaging for defending deep neural networks from adversarial attacks[J]. Optics Letters, 46, 1951-1954(2021).

    [56] Bu T, Kumar S, Zhang H, et al. Single-pixel pattern recognition with coherent nonlinear optics[J]. Opt Lett, 45, 6771-6774(2020).

    [57] Kumar S, Bu T, Zhang H, et al. Robust and efficient single-pixel image classification with nonlinear optics[J]. Opt Lett, 46, 1848-1851(2021).

    [58] Zhou F, Shi X, Chen J, et al. Non-imaging real-time detection and tracking of fast-moving objects using a single-pixel detector[J]. arXiv preprint, 2108.06009(2021).

    [59] Zhang Z B, Ma X, Zhong J G. Single-pixel imaging by means of Fourier spectrum acquisition[J]. Nature Communications, 6, 1-6(2015).

    [60] Zhang Z, Ye J, Deng Q, et al. Image-free real-time detection and tracking of fast moving object using a single-pixel detector[J]. Optics Express, 27, 35394-35401(2019).

    [61] Gustafsson M G L. Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy[J]. Journal of Microscopy, 198, 82-87(2000).

    [62] Deng Q, Zhang Z, Zhong J. Image-free real-time 3-D tracking of a fast-moving object using dual-pixel detection[J]. Optics Letters, 45, 4734-4737(2020).

    [63] Chen H, Shi J, Liu X, et al. Single-pixel non-imaging object recognition by means of Fourier spectrum acquisition[J]. Optics Communications, 413, 269-275(2018).

    [64] Zhen S, Yao M, Wang S, et al. Single-pixel fast-moving object classification based on optical-electronical hybrid neural network (invited)[J]. Infrared and Laser Engineering, 50, 20210856(2021).

    [65] [65] Zisselman E, Adler A, Elad M. Compressed Learning f Image Classification: A Deep Neural wk Approach[M]Hbook of Numerical Analysis. Amsterdam: Elsevier, 2018, 19: 317.

    [66] Xu Y, Liu W, Kelly K F. Compressed domain image classification using a dynamic-rate neural network[J]. IEEE Access, 8, 217711-217722(2020).

    [67] Lohit S, Singh R, Kulkarni K, et al. Rate-adaptive neural networks for spatial multiplexers[J]. arXiv preprint, 1809.02850(2018).

    [68] Bacca J, Galvis L, Arguello H. Coupled deep learning coded aperture design for compressive image classification[J]. Optics Express, 28, 8528-8540(2020).

    [69] Zhang Z, Li X, Zheng S, et al. Image-free classification of fast-moving objects using "learned" structured illumination and single-pixel detection[J]. Optics Express, 28, 13269-13278(2020).

    [70] Liu H, Bian L, Zhang J. Image-free single-pixel segmentation[J]. arXiv preprint, 2108.10617(2021).

    [71] Cao J N, Zuo Y H, Wang H H, et al. Single-pixel neural network object classification of sub-Nyquist ghost imaging[J]. Applied Optics, 60, 9180-9187(2021).

    [72] Baraniuk R G, Wakin M B. Random projections of smooth manifolds[J]. Foundations of Computational Mathematics, 9, 51-77(2009).

    [73] [73] Waagen D, Shah N, daz M, et al. Cassabaum, rom subspaces SAR classification efficacy[C]Proceedings of SPIE, 2005, 5808: 305308.

    [74] [74] Duarte M F, Davenpt M A, Wakin M B, et al. Sparse signal detection from incoherent projections[C]IEEE International Conference on Acoustics. IEEE, 2006.

    [75] [75] Davenpt M A, Wakin M B, Baraniuk R G. Detection estimation with compressive measurements[EBOL]. (20061101)[20220331]. https:www.mendeley.comcatalogue3242ecd2417d3692822e7000c8fd7496.

    [76] [76] Haupt J, Castro R, Nowak R, et al. Compressive sampling f signal classification[C]2006 Ftieth Asilomar Conference on Signals, Systems Computers. IEEE, 2007.

    [77] [77] Savvides M, Kumar B V, Khosla P. Face verification using crelation filters[C]3rd IEEE Automatic Identification Advanced Technologies, 2002: 56–61.

    [78] Ota S, Horisaki R, Kawamura Y, et al. Ghost cytometry[J]. Science, 360, 1246-1251(2018).

    [79] Weng L, Preneel B. A secure perceptual hash algorithm for image content authentication[J]. Lecture Notes in Computer Science, 7025, 108-121(2011).

    [80] Niu X M, Jiao Y H. An overview of perceptual hashing[J]. Acta Electronica Sinica, 36, 1405-1411(2018).

    [81] [81] Zhang B, Xin Y, Niu X X. Image perceptual hash algithm based on target acter[C]2012 IEEE 13 th International Conference on Communication Technology, 2012: 397–401.

    [82] [82] Chang L, Yan W G, Wang W D. Research on Robust Image Perceptual Hashing Technology Based on Discrete Cosine Transfm[M]Financial Sciences, Management. Berlin, Heidelberg: Springer, 2012: 799809.

    [83] Ryu J, Hong S S, Horn B K P, et al. Multibeam interferometric illumination as the primary source of resolution in optical microscopy[J]. Applied Physics Letters, 88, 171112(2006).

    [84] Dan D, Lei M, Yao B, et al. DMD-based LED-illumination super-resolution and optical sectioning microscopy[J]. Scientific Reports, 3, 1-7(2013).

    [85] Turan A. A weighted Euclidean distance based TOPSIS method for modeling public subjective judgments[J]. Asia-Pacific Journal of Operational Research, 34, 1750004(2017).

    [86] Adler A, Elad M, Zibulevsky M. Compressed learning: A deep neural network approach[J]. arXiv preprint, 1610.09615(2016).

    [87] Hinojosa C, Bacca J, Arguello H. Coded aperture design for compressive spectral subspace clustering[J]. IEEE Journal of Selected Topics in Signal Processing, 12, 1589-1600(2018).

    [88] [88] Bacca J, Crea C V, Vargas E, et al. Compressive classification from single pixel measurements via deep learning[C]2019 IEEE 29th International Wkshop on Machine Learning f Signal Processing (MLSP), 2019: 16.

    [89] [89] Ronneberger O, Fischer P, Brox T. U: Convolutional wks f biomedical image segmentation[C]International Conference on Medical Image Computing ComputerAssisted Intervention, 2015.

    [90] Zhou Z, Siddiquee M M R, Tajbakhsh N, et al. Unet++: Redesigning skip connections to exploit multiscale features in image segmentation[J]. IEEE Transactions on Medical Imaging, 39, 1856-1867(2019).

    [91] [91] Huang H, Lin L, Tong R, et al. U 3+: A fullscale connected u f medical image segmentation[C]ICASSP 20202020 IEEE International Conference on Acoustics, Speech Signal Processing (ICASSP), 2020: 10551059.

    [92] [92] Cao J, Cholakkal H, Rao M, et al. D2 Det: Towards high quality object detection instance segmentation[C]2020 IEEECVF Conference on Computer Vision Pattern Recognition (CVPR), 2020.

    [93] [93] Stern A, Evladov S, Kashter Y, et al. Anamphic optics f compressive imaging compressive motion tracking[C]2012 11th EuroAmerican Wkshop on Infmation Optics, 2012: 13.

    [94] Lohit S, Kulkarni K, Kerviche R, et al. Convolutional neural networks for noniterative reconstruction of compressively sensed images[J]. IEEE Transactions on Computational Imaging, 4, 326-340(2018).

    [95] Zhang Z, Lu T, Peng J, et al. Single-pixel imaging technology and application[J]. Infrared and Laser Engineering, 48, 0603002(2019).

    [96] Khakimov R I, Henson B M, Shin D K, et al. Ghost imaging with atoms[J]. Nature, 540, 100-103(2016).

    [97] Ryczkowski P, Barbier M, Friberg A T, et al. Ghost imaging in the time domain[J]. Nature Photon, 10, 167-170(2016).

    [98] Zhao H, Guo Y, Li P, et al. Signal to noise ratio analysis of single pixel imaging and its development in special bands[J]. Laser & Optoelectronics Progress, 58, 1011010(2021).

    [99] [99] Single pixel complex amplitude holography can be applied to microscopic imaging of biological tissue[J]. Biomedical Engineering Clinic, 2021, 25 (6): 714. (in Chinese)

    [100] He Y, Huang Y, Zeng Z, et al. Single-pixel imaging with neutrons[J]. Science Bulletin, 66, 133-138(2021).

    [101] Stantchev R, Yu X, Blu T, et al. Real-time terahertz imaging with a single-pixel detector[J]. Nature Communications, 11, 1-8(2020).

    [102] Lin R, Zheng Y, Chen S. Research on opportunities and problems of international application and promotion of satellite remote sensing in China[J]. Satellite Applications, 45-51(2021).

    [103] Lu Y, Zhan W, Hu C. Detecting and quantifying oil slick thickness by thermal remote sensing: A ground-based experiment[J]. Remote Sensing of Environment, 181, 207-217(2016).

    [104] Erkmen B I. Computational ghost imaging for remote sensing[J]. JOSA A, 29, 782-789(2012).

    [105] Li Z P, Ye J T, Huang X, et al. Single-photon imaging over 200 km[J]. Optica, 8, 344-349(2021).

    [106] Jiao S, Zhou C, Shi Y, et al. Review on optical image hiding and watermarking techniques[J]. Optics & Laser Technology, 109, 370(2019).

    [107] Feng J, Huang W, Jiao S, et al. Generalized forgery attack to optical encryption systems[J]. Optics Express, 29, 43580-43597(2021).

    Tools

    Get Citation

    Copy Citation Text

    Liheng Bian, Xinrui Zhan, Huayi Wang, Haiyan Liu, Jinli Suo. Overview of efficient single-pixel sensing methods[J]. Infrared and Laser Engineering, 2022, 51(8): 20220231

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Optical imaging

    Received: Mar. 31, 2022

    Accepted: May. 17, 2022

    Published Online: Jan. 9, 2023

    The Author Email: Liheng Bian (bian@bit.edu.cn), Jinli Suo (jlsuo@tsinghua.edu.cn)

    DOI:10.3788/IRLA20220231

    Topics