Infrared and Laser Engineering, Volume. 53, Issue 9, 20240347(2024)
Light field representation and its resolution improvement techniques: an overview (invited)
[2] [2] BRADY D J. Optical Imaging Spectroscopy[M]. New Yk: John Wiley & Sons, 2009.
[3] [3] WETZSTEIN G, IHRKE I, LANMAN D, et al. Computational plenoptic imaging[C]Computer Graphics Fum, 2011, 30(8): 23972426.
[9] Runnan ZHANG, Zewei CAI, Jiasong SUN et al. Optical-Field coherence measurement and its applications in computational imaging. Laser & Optoelectronics Progress, 58, 1811003(2021).
[11] [11] IVES F E. Parallax stereogram process of making same: US, 725567 [P]. 19030414.
[12] G LIPPMANN. La photographie integrale. Comptes-Rendus, 146, 446-451(1908).
[15] Y A DUDNIKOV. Autostereoscopy and integral photography. Optical Technology, 37, 422-426(1970).
[16] [16] DUDLEY L. Methods of integral photography: US, 675553[P]. 19720711.
[17] [17] DE MONTEBELLO R L. Wideangle integral photographythe integram system[C]ThreeDimensional Imaging, 1977, 120: 7391.
[18] [18] ADELSON E H, BERGEN J R. The Plenoptic Function The Elements of Early Vision[M]. Cambridge: Massachusetts Institute of Technology, 1991.
[19] Yaning LI, Xue WANG, Guoqing ZHOU et al. Overview of 4D light field representation. Laser & Optoelectronics Progress, 58, 1811012(2021).
[21] [21] MCMILLAN L, BISHOP G. Plenoptic modeling: an imagebased rendering system[C]Proceedings of the 22nd annual conference on computer graphics interactive techniques, 1995: 3946.
[22] [22] LEVOY M, HANRAHAN P. Light field rendering[C]Proceedings of the 23rd Annual Conference on ComputEr Graphics Interactive Techniques, 1996: 3142.
[23] [23] GTLER S J, GRZESZCZUK R, SZELISKI R, et al. The lumigraph[C]Proceedings of the 23rd Annual Conference on Computer Graphics Interactive Techniques, 1996: 4354.
[24] [24] TESTF M, HENNELLY B, OJEDACASTANEDA J. PhaseSpace Optics: Fundamentals Applications[M]. New Yk: McGraw Hill, 2009.
[26] L DOLIN. Beam description of weakly-inhomogeneous wave fields. Izvestiya Vysshih Uchebnyh Zavedenii, 7, 559-563(1964).
[37] [37] ZHANG Z, LEVOY M. Wigner distributions how they relate to the light field[C]2009 IEEE International Conference on Computational Photography (ICCP), 2009: 110.
[39] [39] NG R, LEVOY M, BREDIF M, et al. Light field photography with a hheld plenoptic camera[D]. Califnia: Stanfd University, 2005.
[42] [42] ADELSON E H, BERGEN J R. The Plenoptic function the elements of early vision[J]. Computational Models of Visual Processing , 1991: 18.
[44] [44] MOON P, SPENCER D E. The Photic Field[M]. Cambridge: Massachusetts Institute of Technology, 1981.
[47] [47] CAMAHT E, LERIOS A, FUSSELL D. Unifmly sampled light fields[C]Eurographics Wkshop on Rendering Techniques, 1998: 117130.
[48] [48] LEVIN A, FREEMAN W T, DUR F. Understing camera tradeoffs through a bayesian analysis of light field projections[C]Computer Vision–ECCV, 2008: 88101.
[49] [49] NG R, HANRAHAN P M. Digital crection of lens aberrations in light field photography[C]International Optical Design Conference, 2006: WB2.
[50] [50] WEI L Y, LIANG C K, MYHRE G, et al. Improving light field camera sample design with irregularity aberration[J]. ACM Transactions on Graphics , 2015, 34(4): 152: 11.
[52] [52] WU J, GUO Y, DENG C, et al. An integrated imaging sens f aberrationcrected 3D photography[J]. Nature , 2022: 110.
[54] [54] FSYTH D A, PONCE J. ComputeR Vision: A Modern Approach[M]. Hoboken: Prentice Hall, 2002.
[55] [55] CHEN S E. Quicktime VR: An imagebased approach to virtual environment navigation[C]Proceedings of the 22nd Annual Conference on Computer Graphics Interactive Techniques, 1995: 2938.
[56] [56] CHAI J X, TONG X, CHAN S C, et al. Plenoptic sampling[C]Proceedings of the 27th Annual Conference on Computer Graphics Interactive Techniques, 2000: 307318.
[57] [57] ISAKSEN A, MCMILLAN L, GTLER S J. Dynamically reparameterized light fields[C]Proceedings of the 27th Annual Conference on Computer Graphics Interactive Techniques, 2000: 297306.
[59] [59] CAO X, LIU Y, JI X, et al. Vision field capture f advanced 3DTV applications[C]Visual Communications Image Processing (VCIP), 2011: 14.
[60] [60] JONES A, MCDOWALL I, YAMADA H, et al. Rendering f an interactive 360° light field display[C]ACM SIGGRAPH, 2007: 40
[61] [61] BROXTON M, FLYNN J, OVERBECK R, et al. Immersive light field video with a layered mesh representation[J]. ACM Transactions on Graphics , 2020, 39(4): 186.
[62] [62] LEVOY M. Volume Rendering Using The Fourier Projectionslice Theem[M]. Califnia: Stanfd University, 1992.
[63] [63] DEANS S R. The Radon Transfm Some of Its Applications[M]. Nth Chelmsfd: Courier Cpation, 2007.
[66] [66] MACOVSKI A. Medical imaging systems[J]. Prentice Hall , 1983.
[67] [67] REN Ng. Fourier slice photography[C]ACM Siggraph, 2005: 735744.
[68] [68] BUZUG T M. Computed tomography[C]Springer Hbook of Medical Technology, 2011: 311342.
[70] A LEVIN, S W HASINOFF, P GREEN. 4D frequency analysis of computational cameras for depth of field extension. ACM Transactions on Graphics, 28, 14(2009).
[71] [71] DANSEREAU D G, PIZARRO O, WILLIAMS S B. Linear volumetric focus f light field cameras[J]. ACM Transactions on Graphics , 2015, 34(2): 15: 115: 20.
[72] [72] LEVOY M, NG R, ADAMS A, et al. Light field microscopy[C] ACM SIGGRAPH, 2006: 924934.
[79] [79] GUO R, YANG Q, CHANG A S, et al. EventLFM: Event camera integrated Fourier light field microscopy f ultrafast 3D imaging[J]. Light : Science & Applications , 2024, 13(1): 144.
[80] [80] ANTIPA N, NECULA S, NG R, et al. Singleshot diffuserencoded light field imaging[C]IEEE International Conference on Computational Photography (ICCP), 2016: 111.
[83] [83] YANNY K, ANTIPA N, LIBERTI W, et al. Miniscope3D: optimized singleshot miniature 3D fluescence microscopy[J]. Light : Science & Applications , 2020, 9(1): 171.
[85] [85] VEERARAGHAVAN A, AGRAWAL A, RASKAR R, et al. Nonrefractive modulats f encoding capturing scene appearance depth[C]IEEE Conference on Computer Vision Pattern Recognition, 2008: 18.
[86] Sheng LI, Bowen WANG, Haitao GUAN. Far-field computational optical imaging techniques based on synthetic aperture: a review. Opto-Electronic Engineering, 50, 230090.(2023).
[87] [87] WILBURN B S, SMULSKI M, LEE H H K, et al. Light field video camera[C]Media Processs, 2001: 2936.
[88] J C YANG, M EVERETT, C BUEHLER et al. A real-time distributed light field camera(2002).
[89] [89] ZHANG C, CHEN T. A selfreconfigurable camera array[C] ACM SIGGRAPH, 2004: 151.
[90] [90] WILBURN B, JOSHI N, VAISH V, et al. High perfmance imaging using large camera arrays[C]ACM SIGGRAPH, 2005: 765776.
[91] [91] WILBURN B, JOSHI N, VAISH V, et al. Highspeed videography using a dense camera array[C]IEEE Computer Society Conference on Computer Vision Pattern Recognition, 2004: 1315176.
[93] T G GEORGIEV, K C ZHENG, B CURLESS et al. Spatio-angular resolution tradeoffs in integral photography, 263-272(2006).
[94] [94] VENKATARAMAN K, LELESCU D, DUPARRÉ J, et al. PiCam: an ultrathin high perfmance monolithic camera array[J]. ACM Transactions on Graphics , 2013, 32(6): 166: 1166: 13.
[95] [95] BISHOP T E, ZATI S, FAVARO P. Light field superresolution[C]IEEE International Conference on Computational Photography (ICCP), 2009: 19.
[107] [107] ZHOU N, ZHANG R, XU W, et al. HighSpeed highresolution transpt of intensity diffraction tomography with biplane parallel detection[J]. Laser & Photonics Reviews , 2024: 2400387.
[108] [108] MARWAH K, WETZSTEIN G, BO Y, et al. Compressive light field photography using overcomplete dictionaries optimized projections[J]. ACM Transactions on Graphics , 2013, 32(4): 46: 112.
[113] [113] LIANG C K, LIN T H, WONG B Y, et al. Programmable aperture photography: multiplexed light field acquisition[C]ACM SIGGRAPH, 2008, 55: 110.
[114] [114] ZHOU C, LIN S, NAYAR S. Coded aperture pairs f depth from defocus[C]IEEE 12th International Conference on Computer Vision, 2009: 325332.
[117] [117] KAUVAR I, CHANG J, WETZSTEIN G. Aperture interference the volumetric resolution of light field fluescence microscopy[C]IEEE International Conference on Computational Photography (ICCP), 2017: 112.
[118] [118] CAI Z, ZHANG R, ZHOU N, et al. Programmable aperture light‐field microscopy[J]. Laser & Photonics Reviews , 2023: 2300217.
[119] [119] LEVIN A, DUR F. Linear view synthesis using a dimensionality gap light field pri[C]IEEE Computer Society Conference on Computer Vision Pattern Recognition, 2010: 18311838.
[120] [120] ZHANG R, ZHOU N, TANG H, et al. High‐Speed multi‐modal extended depth‐of‐field microscopy with an electrically tunable lens[J]. Laser & Photonics Reviews , 2024: 2300770.
[128] [128] WU J, LU Z, JIANG D, et al. Iterative tomography with digital adaptive optics permits hourlong intravital observation of 3D subcellular dynamics at millisecond scale[J]. Cell , 2021: S0092867421005328.
[129] [129] XIONG B, ZHU T, XIANG Y, et al. Mirrenhanced scanning lightfield microscopy f longterm highspeed 3D imaging with isotropic resolution[J]. Light : Science & Applications , 2021, 10(1): 227.
[133] [133] ZHAO Z, ZHOU Y, LIU B, et al. Twophoton synthetic aperture microscopy f minimally invasive fast 3D imaging of native subcellular behavis in deep tissue[J]. Cell , 2023, 186(11): 24752491.
[134] [134] SAWHNEY H S, GUO Y, HANNA K, et al. Hybrid stereo camera: an IBR approach f synthesis of very high resolution stereoscopic image sequences[C]Proceedings of the 28th Annual Conference on Computer Graphics Interactive Techniques, 2001: 451460.
[135] [135] FAVARO P. A splitsens light field camera f extended depth of field superresolution[C]Optics, Photonics, Digital Technologies f Multimedia Applications II, 2012: 1119.
[136] [136] BOOMINATHAN V, MITRA K, VEERARAGHAVAN A. Improving resolution depthoffield of light field cameras using a hybrid imaging system[C] International Conference on Computational Photography (ICCP), 2014: 110.
[138] [138] LU C H, MUENZEL S, FLEISCHER J W. Highresolution lightfield microscopy[C]Imaging Applied Optics, 2013: CTh3B. 2.
[141] [141] LU Z, ZUO S, SHI M, et al. Longterm intravital subcellular imaging with confocal scanning lightfield microscopy[J]. Nature Biotechnology , 2024: 112.
[147] [147] CHEN Ni, ZUO Chao, BYOUNGHO Lee. 3D imaging based on depth measurement[J]. Infrared Laser Engineering, 2019, 48(6): 0603013. (in Chinese)
CHEN Ni, ZUO Chao, BYOUNGHO Lee. 3D imaging based on depth measurement[J]. Infrared Laser Engineering , 2019, 48(6): 0603013. (in Chinese)
[152] [152] WANNER S, GOLDLUECKE B. Spatial angular variational superresolution of 4D light fields[C]Computer vision – ECCV, 2012: 608621.
[154] [154] ZHANG Z, LIU Y, DAI Q. Light field from microbaseline image pair[C]IEEE Conference on Computer Vision Pattern Recognition (CVPR), 2015: 38003809.
[155] [155] PENNER E, ZHANG L. Soft 3D reconstruction f view synthesis[J]. ACM Transactions on Graphics , 2017, 36(6): 235: 111.
[156] [156] SHI L, HASSANIEH H, DAVIS A, et al. Light field reconstruction using sparsity in the continuous Fourier domain[J]. ACM Transactions on Graphics , 2015, 34(1): 12: 112: 13.
[159] [159] ZUO C, QIAN J, FENG S, et al. Deep learning in optical metrology: a review[J]. Light : Science & Applications , 2022, 11(1): 39.
[163] [163] WANG Y, WANG L, YANG J, et al. SpatialAngular interaction f light field image superresolution[C]Computer Vision–ECCV, 2020: 290308.
[164] [164] WU G, ZHAO M, WANG L, et al. Light field reconstruction using deep convolutional wk on EPI[C]IEEE Conference on Computer Vision Pattern Recognition (CVPR), 2017: 16381646.
[165] [165] YEUNG H W F, HOU J, CHEN J, et al. Fast light field reconstruction with deep coarsetofine modeling of spatialangular clues[C] Proceedings of the European Conference on Computer Vision (ECCV), 2018: 137152.
[166] [166] YOON Y, JEON H G, YOO D, et al. Learning a deep convolutional wk f lightfield image superresolution[C]Proceedings of the IEEE international conference on computer vision wkshops, 2015: 2432.
[170] [170] PAN M, FU Y, ZHENG M, et al. Dielectric metalens f miniaturized imaging systems: progress challenges[J]. Light : Science & Applications , 2022, 11(1): 195.
[172] [172] FAN Z B, QIU H Y, ZHANG H L, et al. A broadb achromatic metalens array f integral imaging in the visible[J]. Light : Science & Applications , 2019, 8(1): 67.
[174] [174] VAISH V, GARG G, TALVALA E, et al. Synthetic aperture focusing using a shearwarp factization of the viewing transfm[C]IEEE Computer Society Conference on Computer Vision Pattern Recognition (CVPR''05)Wkshops, 2005: 129139.
[180] F C HUANG, G WETZSTEIN, B A BARSKY et al. Eyeglasses-free display: towards correcting visual aberrations with computational light field displays. ACM Transactions on Graphics, 33, 1-12(2014).
[181] D LANMAN, D LUEBKE. Near-eye light field displays. ACM Transactions on Graphics, 32, 1-10(2013).
Get Citation
Copy Citation Text
Runnan ZHANG, Ning ZHOU, Zihao ZHOU, Heheng DU, Qian CHEN, Chao ZUO. Light field representation and its resolution improvement techniques: an overview (invited)[J]. Infrared and Laser Engineering, 2024, 53(9): 20240347
Category: Special issue—Computational optical imaging and application Ⅱ
Received: Jun. 4, 2024
Accepted: --
Published Online: Oct. 22, 2024
The Author Email: