Acta Optica Sinica, Volume. 40, Issue 1, 0111002(2020)

Applications of Deep Learning in Computational Imaging

Fei Wang1,2, Hao Wang1,2, Yaoming Bian1,2, and Guohai Situ1,2、*
Author Affiliations
  • 1Laboratory of Information Optics and Optoelectronic Technology, Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai 201800, China
  • 2Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
  • show less
    Figures & Tables(11)
    Schematic diagram. (a) Conventional imaging model; (b) computational imaging model
    Schematic of regression problem solved using neural network. (a) Training; (b) testing; (c) fitting process
    Diagram of data acquisition methods in computational imaging. (a) Images reconstructed by traditionally complex and costly methods; (b) presetting real objects with SLM; (c) data obtained by numerical simulation
    Schematic of fully connected neural network. (a) Single hidden layer; (b) multi hidden layers
    Simplified diagram of convolutional neural network. (a) Convolution: different convolution kernels corresponding to different feature maps; (b) pooling: replace data within the scope of operation with its maximum or mean; (c) deconvolution: interpolate data with zeros and then implement convolution; (d) convolution
    Main problems in neural network training. (a) Local minimum; (b) overfitting
    Flow chart of neural network training
    Applications of deep learning in scattering imaging. (a) Imaging through strong scattering media[28,74]; (b) imaging through different ground glasses[27]
    Applications of deep learning in digital holography. (a) Removing twin image[32]; (b) end-to-end phase reconstruction[34]; (c) end-to-end complex amplitude reconstruction[66]
    Applications of deep learning in computational ghost imaging. (a) Improving signal-noise-ratio[29]; (b) reconstructing objects by using intensity sequences[31]
    • Table 1. Typical applications of deep learning in computational imaging

      View table

      Table 1. Typical applications of deep learning in computational imaging

      Imaging problemReferenceTraining dataData obtainingNetwork structureCost function
      Phase imaging[23][24][25]Faces-LFW or ImageNetDatabase,10000HeLa cell,925,human skin tissue,2500Method 2Method 1Method 1CNNCNNGANMAEMAE+regularizationAdversarial loss+TV
      Imaging throughscattering media[26][27][28]MNIST,10000MNIST,2400MNIST,3990Method 2Method 2Method 2CNNCNNCNNMAE, NPCCAveraged cross-entropyMSE
      Computational ghost imaging[29][30][31]MNIST,2000Aircraft model,200MNIST,9000Method 2Method 1Method 3FCNCNNCNNMSENormalized MSEMSE
      Digital holography[32][33][34]Breast tissue slide,100USAF pattern,3750MNIST,9000Method 1Method 1Method 2CNNCNNCNNMSESquare of the L2 normMSE
      Fourier ptychographic microscopy[35][36]Hela cell,20760Animal tissue,23040Method 1Method 1,3GANCNNAdversarial loss+normL1 norm
      Super-resolution[37][38][39]Single-molecule,10000Hela cell,2625Pap smear,65475Method 1,3Method 1Method 1CNNGANGANMSE+L1Adversarial loss+normAdversarial loss+norm
      Imaging in low light[40][41]imageNet,9500Celeba face images,9000Method 2Method 2CNNGANNPCCAdversarial loss+MSE
      Phase unwrapping[42][43]Random surface,30000Random surface,25000Method 3Method 3CNNCNNMSEMSE
      Fringe analysis[44][45]Fringe images,960Fringe pattern,80000Method 2Method 3CNNCNNMAEMAE
      Optical tomography[46][47][48]Retinal images,55080NIH3T3 cells,5512Retinal image,16000Method 1Method 2Method 1CNNGANGANMSEAdversarial loss+normAdversarial loss+norm
      Multimode fiberimaging[49][50]MINST,16000Handwritten latin alphabet,60000Method 2Method 2CNNCNNMSEMSE
    Tools

    Get Citation

    Copy Citation Text

    Fei Wang, Hao Wang, Yaoming Bian, Guohai Situ. Applications of Deep Learning in Computational Imaging[J]. Acta Optica Sinica, 2020, 40(1): 0111002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Special Issue on Computational Optical Imaging

    Received: Oct. 15, 2019

    Accepted: Nov. 26, 2019

    Published Online: Jan. 6, 2020

    The Author Email: Situ Guohai (ghsitu@siom.ac.cn)

    DOI:10.3788/AOS202040.0111002

    Topics