Advanced Photonics Nexus, Volume. 2, Issue 1, 016012(2023)
Hybrid reconstruction of the physical model with the deep learning that improves structured illumination microscopy
Fig. 1. TDV-SIM diagrams and parameter selection. (a) TDV-SIM reconstruction pipeline. (b) Visualization of TDV and its gradient. Mi is a residual structure micro-block and GM is its gradient. Conv is the convolution layer and T-Conv is its gradient. Act is the activation layer and GAct is its gradient. (c) Actin filaments SIM SR image. (d) Top, PSNR and SSIM of TDV-SIM reconstructions with different
Fig. 2. TDV-SIM outperforms other reconstruction algorithms in suppressing artifacts and hallucinations while maintaining resolution. (a) Actin filaments under the SR-SIM. (b) Magnified views of the larger boxed region in panel (a) reconstructed by Wiener deconvolution, HiFi-SIM, Hessian-SIM, and TDV-SIM. The GT image is shown as the reference. Profiles along the yellow line are on the bottom. (c) Magnified views of the smaller boxed regions in panel (a) reconstructed by Wiener deconvolution, scU-Net, DFCAN, and TDV-SIM. The GT images are shown as references. (d) Time series imaging of ER under the SR-SIM (
Fig. 3. TDV-SIM enables accurate reconstruction of intricate and dynamic mitochondrial cristae structures in live cells after prolonged bleaching. (a) Mitochondria under the SR-SIM. (b) Time-dependent bleaching in fluorescence intensities of mitochondria. (c) Magnified views of the larger boxed region in panel (a) reconstructed by scU-Net, DFCAN, and TDV-SIM and the corresponding GT image at 0 s. Profiles along the blue line are on the right. (d) Magnified views of the smaller boxed region in panel (a) reconstructed by Wiener deconvolution, HiFi-SIM, Hessian-SIM, and TDV-SIM and the corresponding GT images at 0, 15, and 20 s. (e) The SSIMs of regions enclosed mitochondria from different reconstructions compared to GT images at 0, 15, and 20 s (
Fig. 4. TDV-SIM enables better reconstruction of actin filaments under NL-SIM. (a) Actin filaments under the NL-SIM. (b), (c) Magnified views of the white boxed regions in panel (a) reconstructed by Wiener deconvolution, Hessian-SIM, DFCAN, and TDV-NL-SIM. The GT image is shown as the reference. Profiles along the yellow line are on the bottom. (d) Magnified views of the yellow boxed regions in panel (a) reconstructed by Wiener deconvolution, Hessian-SIM, DFCAN, and TDV-NL-SIM. The GT image is shown as the reference. Yellow arrowheads indicate the inaccurate reconstructions of pure DL-based methods. (e) Artifact variances of actin filaments from background regions in different reconstructions (
Get Citation
Copy Citation Text
Jianyong Wang, Junchao Fan, Bo Zhou, Xiaoshuai Huang, Liangyi Chen, "Hybrid reconstruction of the physical model with the deep learning that improves structured illumination microscopy," Adv. Photon. Nexus 2, 016012 (2023)
Category: Research Articles
Received: Oct. 8, 2022
Accepted: Dec. 21, 2022
Published Online: Jan. 16, 2023
The Author Email: Xiaoshuai Huang (hxs@hsc.pku.edu.cn), Liangyi Chen (lychen@pku.edu.cn)