Laser & Optoelectronics Progress, Volume. 61, Issue 2, 0211033(2024)

Comprehensive Review of Computational Imaging Techniques in Information Restoration and Enhancement (Invited)

Tianyue He1,†... Tingdong Kou1,†, Qican Zhang, Wenjing Chen and Junfei Shen* |Show fewer author(s)
Author Affiliations
  • College of Electronics and Information Engineering, Sichuan University, Chengdu 610065, Sichuan , China
  • show less
    References(55)

    [1] Dun X, Fu Q, Li H T et al. Recent progress in computational imaging[J]. Journal of Image and Graphics, 27, 1840-1876(2022).

    [2] Shao X P, Liu F, Li W et al. Latest progress in computational imaging technology and application[J]. Laser & Optoelectronics Progress, 57, 020001(2020).

    [3] Nan Y L, Shen J F, Zhang Q C. End-to-end computational imaging based on multispectral fusion[J]. Laser & Optoelectronics Progress, 59, 2011010(2022).

    [4] Liu F, Wu X Q, Zhao L et al. Research progress of wide-field and high-resolution computational optical imaging system[J]. Laser & Optoelectronics Progress, 58, 1811001(2021).

    [5] Mohammad N, Meem M, Shen B et al. Broadband imaging with one planar diffractive lens[J]. Sci Rep, 8, 2799-2796(2018).

    [6] Peng Y F, Sun Q L, Dun X et al. Learned large field-of-view imaging with thin-plate optics[J]. ACM Transactions on Graphics, 38, 219(2019).

    [7] He T Y, Zhang Q C, Zhou M W et al. Single-shot hyperspectral imaging based on dual attention neural network with multi-modal learning[J]. Optics Express, 30, 9790-9813(2022).

    [8] Monakhova K, Yanny K, Aggarwal N et al. Spectral DiffuserCam: lensless snapshot hyperspectral imaging with a spectral filter array[J]. Optica, 7, 1298-1307(2020).

    [9] Li X Y, Li Y X, Zhou Y L et al. Real-time denoising enables high-sensitivity fluorescence time-lapse imaging beyond the shot-noise limit[J]. Nature Biotechnology, 41, 282-292(2023).

    [10] Hasinoff S W, Sharlet D, Geiss R et al. Burst photography for high dynamic range and low-light imaging on mobile cameras[J]. ACM Transactions on Graphics, 35, 192(2016).

    [11] Zuo C, Chen Q. Computational optical imaging: an overview[J]. Infrared and Laser Engineering, 51, 20220110(2022).

    [12] Wu J M, Guo Y D, Deng C et al. An integrated imaging sensor for aberration-corrected 3D photography[J]. Nature, 612, 62-71(2022).

    [13] Dowski E R,, Cathey W T. Extended depth of field through wave-front coding[J]. Applied Optics, 34, 1859-1866(1995).

    [14] Kuthirummal S, Nagahara H, Zhou C Y et al. Flexible depth of field photography[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33, 58-71(2011).

    [15] Liu Y K, Zhang C Y, Kou T D et al. End-to-end computational optics with a singlet lens for large depth-of-field imaging[J]. Optics Express, 29, 28530-28548(2021).

    [16] Elmalem S, Giryes R, Marom E. Learned phase coded aperture for the benefit of depth of field extension[J]. Optics Express, 26, 15316-15331(2018).

    [17] Ledesma-Carrillo L M, Lopez-Ramirez M, Rivera-Romero C A et al. Extended depth of field in images through complex amplitude pre-processing and optimized digital post-processing[J]. Computers & Electrical Engineering, 40, 29-40(2014).

    [18] Peng Y F, Fu Q, Heide F et al. The diffractive achromat full spectrum computational imaging with diffractive optics[J]. ACM Transactions on Graphics, 35, 31(2016).

    [19] Sitzmann V, Diamond S, Peng Y F et al. End-to-end optimization of optics and image processing for achromatic extended depth of field and super-resolution imaging[J]. ACM Transactions on Graphics, 37, 114(2018).

    [20] Sun Q L, Wang C L, Fu Q et al. End-to-end complex lens design with differentiate ray tracing[J]. ACM Transactions on Graphics, 40, 71(2021).

    [21] Tseng E, Mosleh A, Mannan F et al. Differentiable compound optics and processing pipeline optimization for end-to-end camera design[J]. ACM Transactions on Graphics, 40, 18(2021).

    [22] Kou T D, Zhang Q C, Zhang C Y et al. Large depth-of-field computational imaging with multi-spectral and dual-aperture optics[J]. Optics Express, 30, 32540-32564(2022).

    [23] Kou T D, Zhang Q C, Zhang C Y et al. Integrated MPCAM: multi-PSF learning for large depth-of-field computational imaging[J]. Information Fusion, 89, 452-472(2023).

    [24] He Z H, Li Z X, Li C J et al. Ultra-high sensitivity sensing based on ultraviolet plasmonic enhancements in semiconductor triangular prism meta-antenna systems[J]. Optics Express, 28, 17595-17610(2020).

    [25] Liu G Y, Hsu W L, Pan J W et al. Refractive and meta-optics hybrid system[J]. Journal of Lightwave Technology, 39, 6880-6885(2021).

    [26] Heide F, Rouf M, Hullin M B et al. High-quality computational imaging through simple lenses[J]. ACM Transactions on Graphics, 32, 149(2013).

    [27] Dun X, Ikoma H, Wetzstein G et al. Learned rotationally symmetric diffractive achromat for full-spectrum computational imaging[J]. Optica, 7, 913-922(2020).

    [28] Chen S Q, Feng H J, Pan D X et al. Optical aberrations correction in postprocessing using imaging simulation[J]. ACM Transactions on Graphics, 40, 192(2021).

    [29] Pinilla S, Miri Rostami S R, Shevkunov I et al. Hybrid diffractive optics design via hardware-in-the-loop methodology for achromatic extended-depth-of-field imaging[J]. Optics Express, 30, 32633-32649(2022).

    [30] Eisemann E, Durand F. Flash photography enhancement via intrinsic relighting[J]. ACM Transactions on Graphics, 23, 673-678(2004).

    [31] Petschnigg G, Szeliski R, Agrawala M et al. Digital photography with flash and no-flash image pairs[J]. ACM Transactions on Graphics, 23, 664-672(2004).

    [32] Krishnan D, Fergus R. Dark flash photography[J]. ACM Transactions on Graphics, 28, 96(2009).

    [33] Li Y J, Huang J B, Ahuja N et al. Joint image filtering with deep convolutional networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41, 1909-1923(2019).

    [34] Lü F F, Zheng Y Q, Li Y C et al. An integrated enhancement solution for 24-hour colorful imaging[J]. Proceedings of the AAAI Conference on Artificial Intelligence, 34, 11725-11732(2020).

    [35] Zhang Z H, Cheng Y X, Suo J L et al. INFWIDE: image and feature space Wiener deconvolution network for non-blind image deblurring in low-light conditions[J]. IEEE Transactions on Image Processing, 32, 1390-1402(2023).

    [36] Dabov K, Foi A, Katkovnik V et al. Image denoising by sparse 3-D transform-domain collaborative filtering[J]. IEEE Transactions on Image Processing, 16, 2080-2095(2007).

    [37] He K M, Sun J, Tang X O. Guided image filtering[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 1397-1409(2013).

    [38] Tang L F, Xiang X Y, Zhang H et al. DIVFusion: darkness-free infrared and visible image fusion[J]. Information Fusion, 91, 477-493(2023).

    [39] Jin S P, Yu B B, Jing M H et al. DarkVisionNet: low-light imaging via RGB-NIR fusion with deep inconsistency prior[J]. Proceedings of the AAAI Conference on Artificial Intelligence, 36, 1104-1112(2022).

    [40] Yan Q, Shen X Y, Xu L et al. Cross-field joint image restoration via scale map[C], 1537-1544(2013).

    [41] Xiong J H, Wang J, Heidrich W et al. Seeing in extra darkness using a deep-red flash[C], 9995-10004(2021).

    [42] Sun Z H, Wang J, Wu Y C, Avidan S, Brostow G, Cissé M et al. Seeing far in the dark with patterned flash[M]. Computer vision-ECCV 2022. Lecture notes in computer science, 13666, 709-727(2022).

    [43] Thomas S. Low-light imaging with SPAD pixels[J]. Nature Electronics, 4, 862(2021).

    [44] Ma S Z, Gupta S, Ulku A C et al. Quanta burst photography[J]. ACM Transactions on Graphics, 39, 79(2020).

    [45] Bonifazi G, Capobianco G, Serranti S. Asbestos containing materials detection and classification by the use of hyperspectral imaging[J]. Journal of Hazardous Materials, 344, 981-993(2018).

    [46] Nie B Y, Yang L, Zhao F et al. Space object material identification method of hyperspectral imaging based on Tucker decomposition[J]. Advances in Space Research, 67, 2031-2043(2021).

    [47] Gowen A A, O’Donnell C P, Cullen P J et al. Hyperspectral imaging-an emerging process analytical tool for food quality and safety control[J]. Trends in Food Science & Technology, 18, 590-598(2007).

    [48] Huang W Q, Li J B, Wang Q Y et al. Development of a multispectral imaging system for online detection of bruises on apples[J]. Journal of Food Engineering, 146, 62-71(2015).

    [49] Kester R T, Bedard N, Gao L S et al. Real-time snapshot hyperspectral imaging endoscope[J]. Journal of Biomedical Optics, 16, 056005(2011).

    [50] Hu B L, Du J, Zhang Z F et al. Tumor tissue classification based on micro-hyperspectral technology and deep learning[J]. Biomedical Optics Express, 10, 6370-6389(2019).

    [51] Li Q L, Wang Y T, Liu H Y et al. Tongue fissure extraction and classification using hyperspectral imaging technology[J]. Applied Optics, 49, 2006-2013(2010).

    [52] Shibi C S, Gayathri R. An efficient hardware implementation of detecting targets from remotely sensed hyperspectral images[J]. Journal of Scientific & Industrial Research, 81, 156-165(2022).

    [53] Li X H, Greenberg J A, Gehm M E. Single-shot multispectral imaging through a thin scatterer[J]. Optica, 6, 864-871(2019).

    [54] Jeon D S, Baek S H, Yi S et al. Compact snapshot hyperspectral imaging with diffracted rotation[J]. ACM Transactions on Graphics, 38, 117(2019).

    [55] Arguello H, Pinilla S, Peng Y F et al. Shift-variant color-coded diffractive spectral imaging system[J]. Optica, 8, 1424-1434(2021).

    Tools

    Get Citation

    Copy Citation Text

    Tianyue He, Tingdong Kou, Qican Zhang, Wenjing Chen, Junfei Shen. Comprehensive Review of Computational Imaging Techniques in Information Restoration and Enhancement (Invited)[J]. Laser & Optoelectronics Progress, 2024, 61(2): 0211033

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems

    Received: Nov. 19, 2023

    Accepted: Dec. 11, 2023

    Published Online: Feb. 6, 2024

    The Author Email: Shen Junfei (shenjunfei@scu.edu.cn)

    DOI:10.3788/LOP232525

    CSTR:32186.14.LOP232525

    Topics