Photonics Research, Volume. 9, Issue 10, 1958(2021)

Quantized Fourier ptychography with binary images from SPAD cameras

Xi Yang1、*, Pavan Chandra Konda1, Shiqi Xu1, Liheng Bian2, and Roarke Horstmeyer1,3,4
Author Affiliations
  • 1Department of Biomedical Engineering, Duke University, Durham, North Carolina 27708, USA
  • 2School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China
  • 3Department of Physics, Duke University, Durham, North Carolina 27708, USA
  • 4Department of Electrical and Computer Engineering, Duke University, Durham, North Carolina 27708, USA
  • show less
    Figures & Tables(10)
    (a) Schematic of an FP imaging system. Time-sequential illumination from different angles is provided by an illumination array. Each LED shifts a unique part of the sample’s Fourier spectrum [shown by circles in (b)] into the imaging lens, producing corresponding bandpass-filtered sample images [example images in (d)]. The three LEDs are chosen as examples in (a), (b), (d), and (e) with a common color scheme. (c) Both operating modes of SPAD array cameras can generate binary images. (d) Experimental FP data and reconstructions using 12-bit image data. (e) Quantized FP performed with binary image measurements provides reconstruction image quality closely matching 12-bit data in (d).
    Example images from a simulation dataset demonstrating four exposure strategies considered in this work based on 32 by 32 LED array. LED positions for selected images (a), (b), (c) are shown in (e). The full high-dynamic-range nature of the dataset can be observed in (1). In (2), uniform exposure method results in most of the image pixel values rounding to zero due to quantization. In (3) and (4), max and informed methods use exposures that are dependent on the sample’s frequency spectrum distribution, leading to low quantization error. (5) Max or informed methods are not sufficient when the extreme case of binary is considered, in which case (6) the median method is chosen.
    Flowchart of the proposed quantized FP reconstruction algorithm. Each step is detailed in Section 2.C.
    Simulation results with quantized FP reconstruction algorithm. (a) Test targets used to assess reconstruction performance with 8-bit imaging (left) and binary 1-bit imaging (right). (b) Example natural scene with unique amplitude and phase. For all cases, reconstruction of high-resolution amplitude and phase from binary image measurements closely matches that from 8-bit image measurement, despite significant decrease in detected information.
    NMSE performance of quantized FP algorithm as a function of raw image bit depth, evaluated using a pathology dataset consisting of 30 unique samples. Each point in plots (a) and (b) is average NMSE across all 30 samples. An example low-resolution image and reconstruction pair is shown for 1-, 2-, 3-, and 8-bit raw image datasets captured with the max illumination strategy.
    Simulation results comparing the influence of FP overlap ratio on reconstruction quality using the max exposure strategy. Each point in the plot is the average NMSE of 12 different samples. (a)–(d) on right refer to sampling rate in Fourier space. Brightness of each pixel in k-space refers to the number of measured images it is associated with. Gaps in the sampled frequency coverage exist below approximately 38% overlap.
    Experimental results from an FP setup using a 12-bit CMOS image sensor, whose image data was binarized post-capture before reconstruction. Quantized FP algorithm reconstructions using binarized image data (median exposure model) closely match standard FP reconstructions from 12-bit images.
    Experimental results from the SPAD array camera. Comparison between the standard FP on the HDR dataset and the quantized FP on the binarized dataset with the median exposure strategy is shown for three different samples.
    (a1), (a2) Example raw SPAD array data captured and (b1), (b2) show the denoised versions. (c1) and (c2) shows the SNR for selected bright-field and dark-field images.
    • Table 1. Proposed Quantized FP Reconstruction

      View table
      View in Article

      Table 1. Proposed Quantized FP Reconstruction

      1: input: initial guess O(k), system pupil P(k), measurements y^n(r), iteration number T, LED number L, and bit-depth M
      2: fort=1,2,,Tdo
      3:     forn=1,2,,Ldo
      4:         ψ(r)=F1[P(k)Ot1,n(kkn)]
      5:         zn(r)=|ψ(r)|2, yn(r)=QM[αn·zn(r)]
      6:        E=|y^n(r)yn(r)|0 ▹ Proposed error-map
      7:        ψ(r)=[y^n(r)αn·2ME+|ψ(r)|(1E)]exp[iψ(r)]
      8:        Ot,n(kkn)=Ot1,n(kkn)δ[P(k)]F[ψ(r)ψ(r)]|P(k)|max[|P(k)|2+ξ] ▹ Sequential Gauss–Newton update
      9: return:OT,L(k)
    Tools

    Get Citation

    Copy Citation Text

    Xi Yang, Pavan Chandra Konda, Shiqi Xu, Liheng Bian, Roarke Horstmeyer. Quantized Fourier ptychography with binary images from SPAD cameras[J]. Photonics Research, 2021, 9(10): 1958

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems, Microscopy, and Displays

    Received: Apr. 27, 2021

    Accepted: Jul. 12, 2021

    Published Online: Sep. 15, 2021

    The Author Email: Xi Yang (xy95@duke.edu)

    DOI:10.1364/PRJ.427699

    Topics