Chinese Optics Letters, Volume. 22, Issue 6, 060002(2024)

SSL Depth: self-supervised learning enables 16× speedup in confocal microscopy-based 3D surface imaging [Invited]

Ze-Hao Wang1,2, Tong-Tian Weng1,2, Xiang-Dong Chen1,2,3, Li Zhao4, and Fang-Wen Sun1,2,3、*
Author Affiliations
  • 1CAS Key Laboratory of Quantum Information, University of Science and Technology of China, Hefei 230026, China
  • 2CAS Center for Excellence in Quantum Information and Quantum Physics, University of Science and Technology of China, Hefei 230026, China
  • 3Hefei National Laboratory, University of Science and Technology of China, Hefei 230088, China
  • 4Anhui Golden-Shield 3D Technology Co., Ltd., Hefei 230011, China
  • show less
    Figures & Tables(5)
    Network architecture. The encoder consists of a ViT and an adapter for accelerated training. Intensity, depth, and width are predicted by three decoders to finally reconstruct the raw data.
    Network modules design. (a) Convert the microscopic imaging stack into patches by a 3D convolution; (b) prediction head design for intensity, depth, and width.
    Examples of raw measurement data. Scale bar is 50 µm.
    Comparative Experiment 1. (a) Confocal microscope intensity image, with the yellow area indicating the field of view for subsequent analysis; (b) depth image obtained from 1× mode data using the traditional commercial algorithm; (c) depth image obtained from 1× mode data using SSL Depth; (d) depth image obtained from 4× mode data using the traditional commercial algorithm; (e) depth image obtained from 4× mode data using SSL Depth; (f) depth image obtained from 16× mode data using SSL Depth; (g) mean absolute error (L1) corresponding to the cross-sectional line, assuming that the traditional commercial 1× result is true. The red dashed line shows the error at 4× speed for the commercial microscope. Scale bar is 50 µm.
    Comparative Experiment 2. (a) Confocal microscope intensity image, with the yellow area indicating the field of view for subsequent analysis; (b) depth image obtained from 1× mode data using the traditional commercial algorithm; (c) depth image obtained from 1× mode data using SSL Depth. Scale bar is 50 µm.
    Tools

    Get Citation

    Copy Citation Text

    Ze-Hao Wang, Tong-Tian Weng, Xiang-Dong Chen, Li Zhao, Fang-Wen Sun, "SSL Depth: self-supervised learning enables 16× speedup in confocal microscopy-based 3D surface imaging [Invited]," Chin. Opt. Lett. 22, 060002 (2024)

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Special Issue: SPECIAL ISSUE ON QUANTUM IMAGING

    Received: Jan. 23, 2024

    Accepted: Feb. 26, 2024

    Published Online: Jun. 18, 2024

    The Author Email: Fang-Wen Sun (fwsun@ustc.edu.cn)

    DOI:10.3788/COL202422.060002

    CSTR:32184.14.COL202422.060002

    Topics