Advanced Photonics Nexus, Volume. 4, Issue 2, 026005(2025)
Adaptable deep learning for holographic microscopy: a case study on tissue type and system variability in label-free histopathology
Fig. 1. (Top row) Simplified schematic of in-line digital holographic microscopy. The complex-valued transmittance of a tissue sample of type
Fig. 2. Comparison of sampling results of hologram space using conventional and refined forward models. (a) Sampling results using the conventional forward model, where pixel size (2 to
Fig. 3. Effect of the backpropagation operator. Contrastive learning was applied to complex-valued fields from five tissue types: rectum, colon, small bowel, breast, and appendix, across three data categories: “in-focused field,” “propagated field,” and “backpropagated hologram,” as shown in the left panels. The upper row shows the real values, and the lower row shows the imaginary values for each data category. “In-focused field” refers to complex-valued fields captured via off-axis interferometry. Propagated field was generated through numerical propagation of the in-focused field. Backpropagated hologram was simulated by numerically backpropagating the intensity map of propagated field. Both propagated field and backpropagated hologram were simulated with a propagation distance of 15 mm. Middle panels show 2D visualizations obtained from the SimCLR network, where dimensionality reduction of the 512D intermediate vectors was performed using t-SNE. The right panels display FDs between rectum tissue and other tissue types, representing statistical distances within the 512D latent space of the SimCLR network. Scale bar:
Fig. 4. Demonstration of enhanced generalization capability for OOD tissue types. Rectum tissue, used for training both the baseline and proposed models, represents the in-distribution data. In contrast, colon, small bowel, breast, and appendix tissues represent OOD tissue types that were not encountered during training. (a) Holographic reconstruction results from both the baseline and proposed methods. The input holograms were captured with an image-to-sensor distance (propagation distance) of 20 mm. (b) Mean PCC scores of reconstructed images across a distance range of 5 to 20 mm. Each bar in panel (b) is accompanied by an error bar indicating the standard deviation, derived from 375 distinct
Fig. 5. Demonstration of enhanced generalization capability for OOD imaging configurations. The schematic on the left displays the imaging systems used for capturing the holograms. System 1, which has identical imaging configurations to the rectum training data, represents the in-distribution imaging configuration with
Fig. 6. Generalization capability for OOD holograms with distinct tissue types and imaging configurations. The test holograms were captured from OOD tissues (appendix and colon) and OOD imaging systems (objective lens with 10× magnification and 0.25 NA) and evaluated using networks trained on the baseline and proposed methods with rectum data captured from imaging systems equipped with a 20×, 0.4 NA objective lens, and
Fig. 7. Robust phase reconstruction of colorectal cancer tissues across diverse imaging configurations using the proposed method. (a) Schematic of the training and testing process. Normal rectum tissue images, captured with a 20× objective lens, 0.4 NA, and a sensor with a
Get Citation
Copy Citation Text
Jiseong Barg, Chanseok Lee, Chunghyeong Lee, Mooseok Jang, "Adaptable deep learning for holographic microscopy: a case study on tissue type and system variability in label-free histopathology," Adv. Photon. Nexus 4, 026005 (2025)
Category: Research Articles
Received: Oct. 10, 2024
Accepted: Jan. 20, 2025
Published Online: Feb. 19, 2025
The Author Email: Jang Mooseok (mooseok@kaist.ac.kr)