Optical Instruments, Volume. 46, Issue 5, 51(2024)

Multi-modal image reconstruction method based on Trans-MIR model

Yiming LI1... Hao WANG2, Ran LI2, Quan CHEN2, Haijun LU3, and Hui YANG12,* |Show fewer author(s)
Author Affiliations
  • 1School of Medical Instruments, Shanghai University of Medicine and Health Sciences, Shanghai 201318, China
  • 2School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
  • 3Nokia Shanghai Bell Co., LTD., Shanghai 201206, China
  • show less
    References(13)

    [3] BARBASTATHIS G, OZCAN A, SITU G. On the use of deep learning for computational imaging[J]. Optica, 6, 921-943(2019).

    [4] LI S, DENG M, LEE J et al. Imaging through glass diffusers using densely connected convolutional networks[J]. Optica, 5, 803-813(2018).

    [5] [5] DONG C, LOY C C, TANG X O. Accelerating the superresolution convolutional neural wk[C]Proceedings of the 14th European Conference on Computer Vision. Amsterdam, The herls: Springer, 2016: 391 – 407.

    [6] QIAO C, LI D, GUO Y T et al. Evaluation and development of deep neural networks for image super-resolution in optical microscopy[J]. Nature Methods, 18, 194-202(2021).

    [7] YANG J Y, YIN X J, ZHANG M X et al. Learning image formation and regularization in unrolling AMP for lensless image reconstruction[J]. IEEE Transactions on Computational Imaging, 8, 479-489(2022).

    [8] KNOLL F, HOLLER M, KOESTERS T et al. Joint MR-PET reconstruction using a multi-channel image regularizer[J]. IEEE Transactions on Medical Imaging, 36, 1-16(2017).

    [9] BOUSSE A, BERTOLLI O, ATKINSON D et al. Maximum-likelihood joint image reconstruction/motion estimation in attenuation-corrected respiratory gated PET/CT using a single attenuation map[J]. IEEE Transactions on Medical Imaging, 35, 217-228(2016).

    [10] [10] ZANFIR A, ZANFIR M, GBAN A, et al. HUM3DIL: semisupervised multimodal 3D HumanPose estimation f autonomous driving[C] Proceedings of the 6th Conference on Robot Learning. Auckl: PMLR, 2023: 1114 – 1124.

    [11] [11] AN S Z, LI Y, OGRAS U. mRI: multimodal 3D human pose estimation dataset using mmWave, RGBD, inertial senss [EBOL]. [2023–03–01]. https:openreview.pdfid=Oa2cdfBxun.

    [12] [12] VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]Proceedings of the 31st International Conference on Neural Infmation Processing Systems. Long Beach: Curran Associates Inc. , 2017: 6000 – 6010.

    [13] [13] HUANG G B, MATTAR M, BERG T, et al. Labeled faces in the wild: a database fstudying face recognition in unconstrained environments[C]Proceedings of the Wkshop on Faces in ''RealLife'' Images: Detection, Alignment, Recognition. Marseille: Erik LearnedMiller ras Ferencz Frédéric, 2008.

    [14] SPEISER A, MÜLLER L R, HOESS P et al. Deep learning enables fast and dense single-molecule localization with high accuracy[J]. Nature Methods, 18, 1082-1090(2021).

    [15] GUO E L, ZHU S, SUN Y et al. Learning-based method to reconstruct complex targets through scattering medium beyond the memory effect[J]. Optics Express, 28, 2433-2446(2020).

    Tools

    Get Citation

    Copy Citation Text

    Yiming LI, Hao WANG, Ran LI, Quan CHEN, Haijun LU, Hui YANG. Multi-modal image reconstruction method based on Trans-MIR model[J]. Optical Instruments, 2024, 46(5): 51

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Mar. 30, 2023

    Accepted: --

    Published Online: Jan. 3, 2025

    The Author Email: YANG Hui (yangh_23@sumhs.edu.cn)

    DOI:10.3969/j.issn.1005-5630.202303300078

    Topics