PhotoniX, Volume. 4, Issue 1, 26(2023)

Harnessing disordered photonics via multi-task learning towards intelligent four-dimensional light field sensors

Sheng-ke Zhu1,2、†, Ze-huan Zheng3、†, Weijia Meng4,5, Shan-shan Chang1,2, Yingling Tan1, Lu-Jian Chen1、*, Xinyuan Fang4、**, Min Gu4, and Jin-hui Chen1,2,6、***
Author Affiliations
  • 1School of Electronic Science and Engineering, Xiamen University, 361005 Xiamen, China
  • 2Innovation Laboratory for Sciences and Technologies of Energy Materials of Fujian Province (IKKEM), 361005, Xiamen, China
  • 3School of Computer Science and Information Engineering, Xiamen Institute of Technology, 361021 Xiamen, China
  • 4Institute of Photonic Chips, University of Shanghai for Science and Technology, 200093 Shanghai, China
  • 5Centre for Artificial-Intelligence Nanophotonics, School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, 200093 Shanghai, China
  • 6Shenzhen Research Institute of Xiamen University, 518000, Shenzhen, China
  • show less

    [1] [1] Liu Y, Zhang X. Metamaterials: a new frontier of science and technology. Chem Soc Rev. 2011;40(5):2494–507.

    [2] [2] Chen H, Chan CT, Sheng P. Transformation optics and metamaterials. Nat Mater. 2010;9(5):387–96.

    [3] [3] Yu N, Capasso F. Flat optics with designer metasurfaces. Nat Mater. 2014;13(2):139–50.

    [4] [4] Meng Y, Chen Y, Lu L, Ding Y, Cusano A, Fan JA, et al. Optical meta-waveguides for integrated photonics and beyond. Light Sci Appl. 2021;10:235.

    [5] [5] Sun S, He Q, Hao J, Xiao S, Zhou L. Electromagnetic metasurfaces: physics and applications. Adv Opt Photon. 2019;11(2):380–479.

    [6] [6] Yu N, Genevet P, Kats MA, Aieta F, Tetienne JP, Capasso F, et al. Light propagation with phase discontinuities: generalized laws of reflection and refraction. Science. 2011;334(6054):333–7.

    [7] [7] Sun S, He Q, Xiao S, Xu Q, Li X, Zhou L. Gradient-index meta-surfaces as a bridge linking propagating waves and surface waves. Nat Mater. 2012;11(5):426–31.

    [8] [8] Song Q, Liu X, Qiu CW, Genevet P. Vectorial metasurface holography. Appl Phys Rev. 2022;9(1):011311.

    [9] [9] Chen HT, Taylor AJ, Yu N. A review of metasurfaces: physics and applications. Rep Prog Phys. 2016;79(7):076401.

    [10] [10] Li G, Zhang S, Zentgraf T. Nonlinear photonic metasurfaces. Nat Rev Mater. 2017;2:17010.

    [11] [11] Chen WT, Zhu AY, Capasso F. Flat optics with dispersion-engineered metasurfaces. Nat Rev Mater. 2020;5(8):604–20.

    [12] [12] Qu Y, Yi S, Yang L, Yu Z. Multimodal light-sensing pixel arrays. Appl Phys Lett. 2022;121(4):040501.

    [13] [13] Yuan S, Ma C, Fetaya E, Mueller T, Naveh D, Zhang F, et al. Geometric deep optical sensing. Science. 2023;379(6637):eade1220.

    [14] [14] Xiong Y, Wang Y, Zhu R, Xu H, Wu C, Chen J, et al. Twisted black phosphorus–based van der Waals stacks for fiber-integrated polarimeters. Sci Adv. 2022;8(18):eabo0375.

    [15] [15] Ma C, Yuan S, Cheung P, Watanabe K, Taniguchi T, Zhang F, et al. Intelligent infrared sensing enabled by tunable moiré quantum geometry. Nature. 2022;604(7905):266–72.

    [16] [16] Yang Z, Albrow-Owen T, Cai W, Hasan T. Miniaturization of optical spectrometers. Science. 2021;371(6528):eabe0722.

    [17] [17] Yi S, Zhou M, Yu Z, Fan P, Behdad N, Lin D, et al. Subwavelength angle-sensing photodetectors inspired by directional hearing in small animals. Nat Nanotechnol. 2018;13(12):1143–7.

    [18] [18] Ji Z, Liu W, Krylyuk S, Fan X, Zhang Z, Pan A, et al. Photocurrent detection of the orbital angular momentum of light. Science. 2020;368(6492):763–7.

    [19] [19] Tittl A, Leitis A, Liu M, Yesilkoy F, Choi DY, Neshev DN, et al. Imaging-based molecular barcoding with pixelated dielectric metasurfaces. Science. 2018;360(6393):1105–9.

    [20] [20] Wei J, Xu C, Dong B, Qiu CW, Lee C. Mid-infrared semimetal polarization detectors with configurable polarity transition. Nat Photon. 2021;15(8):614–21.

    [21] [21] Wang Z, Yi S, Chen A, Zhou M, Luk TS, James A, et al. Single-shot on-chip spectral sensors based on photonic crystal slabs. Nat Commun. 2019;10:1020.

    [22] [22] Pors A, Nielsen MG, Bozhevolnyi SI. Plasmonic metagratings for simultaneous determination of Stokes parameters. Optica. 2015;2(8):716–23.

    [23] [23] Ni Y, Chen C, Wen S, Xue X, Sun L, Yang Y. Computational spectropolarimetry with a tunable liquid crystal metasurface. eLight. 2022;2:23.

    [24] [24] Lukosz W. Optical systems with resolving powers exceeding the classical limit. J Opt Soc Am. 1966;56(11):1463–71.

    [25] [25] Di Francia GT. Degrees of freedom of an image. J Opt Soc Am A. 1969;59(7):799–804.

    [26] [26] Zuo C, Chen Q. Exploiting optical degrees of freedom for information multiplexing in diffractive neural networks. Light Sci Appl. 2022;11:208.

    [28] [28] Wiersma DS. Disordered photonics. Nat Photon. 2013;7(3):188–96.

    [29] [29] Gigan S. Imaging and computing with disorder. Nat Phys. 2022;18(9):980–5.

    [30] [30] Vandenhende S, Georgoulis S, Van Gansbeke W, Proesmans M, Dai D, Van Gool L. Multi-task learning for dense prediction tasks: A survey. IEEE Trans Pattern Anal Mach Intell. 2021;44(7):3614–33.

    [31] [31] Thung KH, Wee CY. A brief review on multi-task learning. Multimed Tools Appl. 2018;77(22):29705–25.

    [32] [32] Wang Z, Bovik AC, Sheikh HR, Simoncelli EP. Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process. 2004;13(4):600–12.

    [33] [33] Ballard Z, Brown C, Madni AM, Ozcan A. Machine learning and computation-enabled intelligent sensor design. Nat Mach Intell. 2021;3(7):556–65.

    [34] [34] Maguid E, Yannai M, Faerman A, Yulevich I, Kleiner V, Hasman E. Disorder-induced optical transition from spin Hall to random Rashba effect. Science. 2017;358(6369):1411–5.

    [35] [35] Kendall A, Gal Y, Cipolla R. Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. In: Proc. IEEE Conf. Comput. Vis. Pattern Recog. 2018. p. 7482–7491.

    [36] [36] Rubin NA, Shi Z, Capasso F. Polarization in diffractive optics and metasurfaces. Adv Opt Photon. 2021;13(4):836–970.

    [37] [37] Schaefer B, Collett E, Smyth R, Barrett D, Fraher B. Measuring the Stokes polarization parameters. Am J Phys. 2007;75(2):163–8.

    [38] [38] Wang J, Yang JY, Fazal IM, Ahmed N, Yan Y, Huang H, et al. Terabit free-space data transmission employing orbital angular momentum multiplexing. Nat Photon. 2012;6(7):488–96.

    [39] [39] Shen Y, Wang X, Xie Z, Min C, Fu X, Liu Q, et al. Optical vortices 30 years on: OAM manipulation from topological charge to multiple singularities. Light Sci Appl. 2019;8:90.

    [40] [40] Padgett M, Bowman R. Tweezers with a twist. Nat Photon. 2011;5(6):343–8.

    [41] [41] Fang X, Ren H, Gu M. Orbital angular momentum holography for high-security encryption. Nat Photon. 2020;14(2):102–8.

    [42] [42] Ouyang X, Xu Y, Xian M, Feng Z, Zhu L, Cao Y, et al. Synthetic helical dichroism for six-dimensional optical orbital angular momentum multiplexing. Nat Photon. 2021;15(12):901–7.

    [43] [43] Fu S, Zhai Y, Zhang J, Liu X, Song R, Zhou H, Gao C. Universal orbital angular momentum spectrum analyzer for beams. PhotoniX. 2020;1(19):1–12.

    [44] [44] Raskatla V, Singh B, Patil S, Kumar V, Singh R. Speckle-based deep learning approach for classification of orbital angular momentum modes. J Opt Soc Am A. 2022;39(4):759–65.

    [45] [45] Liu Y, Zhang Z, Yu P, Wu Y, Wang Z, Li Y, et al. Learning-enabled recovering scattered data from twisted light transmitted through a long standard multimode fiber. Appl Phys Lett. 2022;120(13):131101.

    [46] [46] Zhao Q, Yu PP, Liu YF, Wang ZQ, Li YM, Gong L. Light field imaging through a single multimode fiber for OAM-multiplexed data transmission. Appl Phys Lett. 2020;116(18):181101.

    [47] [47] Wang J, Fu S, Shang Z, Hai L, Gao C. Adjusted EfficientNet for the diagnostic of orbital angular momentum spectrum. Opt Lett. 2022;47(6):1419–22.

    [48] [48] Fu S, Shang Z, Hai L, Huang L, Lv Y, Gao C. Orbital angular momentum comb generation from azimuthal binary phases. Adv Photon Nexus. 2022;1(1):016003.

    [49] [49] Fang X, Ren H, Li K, Luan H, Hua Y, Zhang Q, et al. Nanophotonic manipulation of optical angular momentum for high-dimensional information optics. Adv Opt Photon. 2021;13(4):772–833.

    [50] [50] Willner AE, Huang H, Yan Y, Ren Y, Ahmed N, Xie G, et al. Optical communications using orbital angular momentum beams. Adv Opt Photon. 2015;7(1):66–106.

    [51] [51] Du J, Wang J. Design of on-chip N-fold orbital angular momentum multicasting using V-shaped antenna array. Sci Rep. 2015;5:9662.

    [52] [52] Ma L-L, Li C-Y, Pan J-T, Ji Y-E, Jiang C, Zheng R, Wang Z-Y, Wang Y, Li B-X, Lu Y-Q. Self-assembled liquid crystal architectures for soft matter photonics. Light Sci Appl. 2022;11:270.

    [53] [53] Guo Y, Jiang M, Peng C, Sun K, Yaroshchuk O, Lavrentovich O, Wei Q-H. High-resolution and high-throughput plasmonic photopatterning of complex molecular orientations in liquid crystals. Adv Mater. 2016;28(12):2353–8.

    [54] [54] Liu Z, Wang L, Meng Y, He T, He S, Yang Y, et al. All-fiber high-speed image detection enabled by deep learning. Nat Commun. 2022;13:1433.

    [55] [55] Tang P, Zheng K, Yuan W, Pan T, Xu Y, Fu S, et al. Learning to transmit images through optical speckle of a multimode fiber with high fidelity. Appl Phys Lett. 2022;121(8):081107.


    Get Citation

    Copy Citation Text

    Sheng-ke Zhu, Ze-huan Zheng, Weijia Meng, Shan-shan Chang, Yingling Tan, Lu-Jian Chen, Xinyuan Fang, Min Gu, Jin-hui Chen. Harnessing disordered photonics via multi-task learning towards intelligent four-dimensional light field sensors[J]. PhotoniX, 2023, 4(1): 26

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Research Articles

    Received: May. 21, 2023

    Accepted: Aug. 2, 2023

    Published Online: Sep. 18, 2023

    The Author Email: Chen Lu-Jian (, Fang Xinyuan (, Chen Jin-hui (