Journal of Innovative Optical Health Sciences, Volume. 18, Issue 2, 2343001(2025)

Diagnosis of osteosarcoma based on multimodal microscopic imaging and deep learning

Zihan Wang1、§, Jinjin Wu1、§, Chenbei Li2, Bing Wang1, Qingxia Wu1, Lan Li3, Huijie Wang1, Chao Tu2,4、*, and Jianhua Yin1、**
Author Affiliations
  • 1Department of Biomedical Engineering, College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu 211106, P. R. China
  • 2Department of Orthopaedics, The Second Xiangya Hospital of Central South University, Changsha, Hunan 410011, P. R. China
  • 3Department of Pathology, The Second Xiangya Hospital of Central South University, Changsha, Hunan 410011, P. R. China
  • 4Shenzhen Research Institute of Central South University, Shenzhen, Guangdong 518063, P. R. China
  • show less

    Osteosarcoma is the most common primary bone tumor with high malignancy. It is particularly necessary to achieve rapid and accurate diagnosis in its intraoperative examination and early diagnosis. Accordingly, the multimodal microscopic imaging diagnosis system constructed by bright field, spontaneous fluorescence and polarized light microscopic imaging was used to study the pathological mechanism of osteosarcoma from the tissue microenvironment level and achieve rapid and accurate diagnosis. First, the multimodal microscopic images of normal and osteosarcoma tissue slices were collected to characterize the overall morphology of the tissue microenvironment of the samples, the arrangement structure of collagen fibers and the content and distribution of endogenous fluorescent substances. Second, based on the correlation and complementarity of the feature information contained in the three single-mode images, combined with convolutional neural network (CNN) and image fusion methods, a multimodal intelligent diagnosis model was constructed to effectively improve the information utilization and diagnosis accuracy. The accuracy and true positivity of the multimodal diagnostic model were significantly improved to 0.8495 and 0.9412, respectively, compared to those of the single-modal models. Besides, the difference of tissue microenvironments before and after cancerization can be used as a basis for cancer diagnosis, and the information extraction and intelligent diagnosis of osteosarcoma tissue can be achieved by using multimodal microscopic imaging technology combined with deep learning, which significantly promoted the application of tissue microenvironment in pathological examination. This diagnostic system relies on its advantages of simple operation, high efficiency and accuracy and high cost-effectiveness, and has enormous clinical application potential and research significance.

    Tools

    Get Citation

    Copy Citation Text

    Zihan Wang, Jinjin Wu, Chenbei Li, Bing Wang, Qingxia Wu, Lan Li, Huijie Wang, Chao Tu, Jianhua Yin. Diagnosis of osteosarcoma based on multimodal microscopic imaging and deep learning[J]. Journal of Innovative Optical Health Sciences, 2025, 18(2): 2343001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Research Articles

    Received: Aug. 31, 2023

    Accepted: Nov. 13, 2023

    Published Online: Apr. 7, 2025

    The Author Email: Chao Tu (tuchao@csu.edu.cn), Jianhua Yin (yin@nuaa.edu.cn)

    DOI:10.1142/S1793545823430010

    Topics