Optics and Precision Engineering, Volume. 29, Issue 9, 2019(2021)

Review of projection display technology in augmented reality surgical navigation system

Hai-bin WU1... Kai-yang XU1, Shuang YU1, Ai-li WANG1,*, Yu-ji IWAHORI2 and Xiao-ming SUN1 |Show fewer author(s)
Author Affiliations
  • 1Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin50080, China
  • 2Computer Science, Chubu University, Aichi487-8501, Japan
  • show less
    Figures & Tables(21)
    Key technologies of surgical navigation system
    AR surgical navigation
    Video assisted thoracoscopic surgery navigation system for resection of tumor at the top of liver[40]
    Multimodal navigation images for 3D-LHNS laparoscopic hepatectomy[45]
    Fixed display equipment
    Mobile handheld display device
    Mobile phone screen surveillance of hematoma location markers[48]
    Doctors wear 3D glasses to view enhanced images on stationary display
    Translucent screen
    Medarpa system with translucent screen[51]
    Video perspective head-mounted display
    Principle of intraoperative navigation display in Google glasses
    Projection display technology
    Location of intracranial hematoma with body surface projection
    Principle for calibration method based on homography
    Texture mapping
    Bezier surface
    Correction of projection distortion of irregular surface[99]
    Quadric surface imaging relationship
    • Table 1. Comparison of display techniques of AR surgical navigation system

      View table
      View in Article

      Table 1. Comparison of display techniques of AR surgical navigation system

      显示技术优 点缺 点适用手术注意事项

      固定式

      视频显示

      分辨率高,造价低只能把视频图像生成在固定设备表面,影响手术连贯性腹腔、胸腔、颅腔手术需医生佩戴3D眼镜,需保持室内昏暗

      移动式

      视频显示

      分辨率高,体积小易于移动,无需额外的设备及应用程序影响其操作范围及活动能力,低端设备易产生延迟,屏幕小限制医生的观察视野,影响手术连贯性腹腔、颅腔,简易手术定位要求画面平稳

      半透明式

      屏幕

      (立体显示)

      准确地叠加显示,对手术部位原位放大限制医生操作自由度,扩展性差牙科、颌面整形科、骨科等刚性组织的临床手术要求设备固定在手术部位上

      头戴式

      显示器

      (立体显示)

      保持融合一致性,较好处理干扰问题,无需移动视线,提高医生手术操作连贯性不适感,易受干扰,手术难度大腹腔、胸腔手术要求医生熟练掌握使用方法,习惯不适感
      投影显示手术操作连贯性高,操作空间大,医生负担及不适感小,设备价格相对低廉,经济负担小显示画面易随体表产生形变,影响手术精准度腹腔、胸腔、颅腔手术要求设备分辨率高
    • Table 2. Comparison of projection display distortion correction methods

      View table
      View in Article

      Table 2. Comparison of projection display distortion correction methods

      校正方法适应表面准确度说明代表文献
      基于单应的校正方法平面取决于获取点云的致密程度线性Yang等79、Takahashi等80
      基于网格的校正方法参数化曲面及非规则面取决于网格疏密程度分段线性及非线性拟合Zhou等84、蓝建梁等86
      基于Bezier函数拟合的校正方法

      曲面及

      非规则面

      取决于Bezier曲面次数

      非线性

      拟合

      Bhasker等89、杨杰等90

      基于二次

      曲面拟合的校正方法

      二次曲面取决于获取点云的致密程度

      非线性

      拟合

      Raskar等92、Steimle等100
    Tools

    Get Citation

    Copy Citation Text

    Hai-bin WU, Kai-yang XU, Shuang YU, Ai-li WANG, Yu-ji IWAHORI, Xiao-ming SUN. Review of projection display technology in augmented reality surgical navigation system[J]. Optics and Precision Engineering, 2021, 29(9): 2019

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Modern Applied Optics

    Received: Feb. 9, 2021

    Accepted: --

    Published Online: Nov. 22, 2021

    The Author Email: WANG Ai-li (aili925@hrbust.edu.cn)

    DOI:10.37188/OPE.20212909.2019

    Topics