Laser & Optoelectronics Progress, Volume. 59, Issue 20, 2011014(2022)

Augmented Reality Computational Spectral Imaging for Surgical Guidance

Chenning Tao1、* and Zhenrong Zheng2
Author Affiliations
  • 1Hangzhou Institute of Advanced Studies, Zhejiang Normal University, Hangzhou 311231, Zhejiang, China
  • 2College of Optical Science and Engineering, Zhejiang University, Hangzhou 310027, Zhejiang, China
  • show less

    Surgical guidance based on spectral imaging can effectively identify various tissue types by analyzing the spectrum differences of different tissues, which has a significant application value. However, the current sampling speed of spectral imaging and the presentation of spectral images severely limit its clinical applications. This paper proposes an augmented reality (AR) computational spectral imaging system for facilitating surgical guidance. High-quality spectral reconstruction is achieved in a single detection using RGB imaging devices and multispectral single-pixel detectors, which greatly improves the imaging speed and reconstruction efficiency. Principal component analysis and spectral angle mapping are adopted to extract the effective information of the spectral images, which are then used to highlight the characteristic tissue area. The image enhancement effect based on the fusion of the spectral image and actual surgical area is demonstrated in the head-mounted AR display device.

    Tools

    Get Citation

    Copy Citation Text

    Chenning Tao, Zhenrong Zheng. Augmented Reality Computational Spectral Imaging for Surgical Guidance[J]. Laser & Optoelectronics Progress, 2022, 59(20): 2011014

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems

    Received: Jun. 14, 2022

    Accepted: Sep. 5, 2022

    Published Online: Oct. 13, 2022

    The Author Email: Tao Chenning (taochenning@zjnu.edu.com)

    DOI:10.3788/LOP202259.2011014

    Topics