Spectroscopy and Spectral Analysis, Volume. 45, Issue 2, 551(2025)

Transformer-Based Method for Segmentation of Gastric Cancer Microscopic Hyperspectral Images

ZHANG Ran1,2, JIN Wei1,2, MU Ying1, YU Bing-wen2, BAI Yi-wen2, SHAO Yi-bo1,2, PING Jin-liang3、*, SONG Peng-tao3, HE Xiang-yi3, LIU Fei3, and FU Lin-lin3
Author Affiliations
  • 1College of Control Science and Engineering, Zhejiang University, Hangzhou 310058, China
  • 2Huzhou Institute of Zhejiang University, Huzhou 313000, China
  • 3Huzhou Central Hospital, Huzhou 313000, China
  • show less

    Gastric cancer is the third leading cause of cancer-related deaths globally, posing a serious threat to human life and health. Therefore, early identification of gastric cancer lesions is crucial for early diagnosis of gastric cancer. As an emerging technique, microscopic hyperspectral imaging technology can simultaneously obtain rich spectral information and spatial information of biological tissues at the microscopic level, providing a new approach for early pathological slice diagnosis. In this paper, gastric cancer microscopic hyperspectral images in the range of 400~1 000 nm were collected using a microscopic hyperspectral imaging system. The gastric cancer microscopic hyperspectral dataset containing 230 images was constructed through preprocessing, such as spectral calibration. Although spatial attention-based methods have achieved significant results in image classification, segmentation, and other fields, they still face challenges of high computational complexity and insufficient utilization of spectral information when dealing with hyperspectral images. Therefore, this paper proposes a backbone network model based on convolution and attention mechanism called Mixing Dual-Branch Transformer (MDBT). This model achieves spatial and channel feature aggregation between blocks and within blocks by alternately applying spatial and channel mixing modules. Specifically, this paper designs window attention, convolution dual branches, and spatial and channel interaction structures. This design not only reduces computational complexity but also achieves window-to-window information interaction and feature fusion through convolutional interaction, overcoming the limitation of window attention's receptive field and further improving the global modeling ability of the Transformer. In the image segmentation experiments, we adopt the UperNet model as the decode head network to reconstruct the features extracted by the backbone network to obtain the final segmentation results. Five-fold cross-validation experiments were conducted on the collected gastric cancer hyperspectral dataset, and the results show that the average priceand mIoU of this paper's model reach 85.39 and 74.66, respectively, outperforming mainstream image segmentation network models such as UNet, Swin, PVT, and VIT. Meanwhile, ablation experiments are designed to verify the optimization effects of the proposed spatial and channel dual mixing modules, convolution, window attention dual branches, and other structures on experimental results. Experimental results demonstrate that the proposed MDBT model can effectively utilize hyperspectral images' rich spatial and spectral information, improve the accuracy of gastric cancer image segmentation, and prove the research significance and application value of microscopic hyperspectral imaging technology in gastric cancer diagnosis.

    Tools

    Get Citation

    Copy Citation Text

    ZHANG Ran, JIN Wei, MU Ying, YU Bing-wen, BAI Yi-wen, SHAO Yi-bo, PING Jin-liang, SONG Peng-tao, HE Xiang-yi, LIU Fei, FU Lin-lin. Transformer-Based Method for Segmentation of Gastric Cancer Microscopic Hyperspectral Images[J]. Spectroscopy and Spectral Analysis, 2025, 45(2): 551

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Received: Mar. 27, 2024

    Accepted: May. 21, 2025

    Published Online: May. 21, 2025

    The Author Email: PING Jin-liang (pjl0173@163.com)

    DOI:10.3964/j.issn.1000-0593(2025)02-0551-07

    Topics