Chinese Optics, Volume. 16, Issue 1, 44(2023)

Panoramic endoscopic imaging technology and it’s applications

Jia-yi HUO1, Mian-hao LI1, Zi-chuan WANG1, Bo YUAN1, Qing YANG2, and Li-qiang WANG2、*
Author Affiliations
  • 1College of Optical Science and Engineering, Zhejiang University, Hangzhou 310027, china
  • 2Research Center for Humanoid Sensing, Zhejiang Lab., Hangzhou 311100, china
  • show less
    References(76)

    [6] ZAMMIT S C, MCALINDON M E, SIDHU R. PTU-084 the use of panoramic capsule endoscopy in obscure gastrointestinal bleeding[J]. Gut, 68, A233(2019).

    [11] [11] POPOVIC V, SEYID K, COGAL , et al. . Stateoftheart multicamera systems[M]POPOVIC V, SEYID K, COGAL , et al. . Design Implementation of RealTime MultiSens Vision Systems. Cham: Springer, 2017: 1331.

    [12] [12] ZENG J L, CHENG Y H, WU T Y, et al. . MicroEYE: a wireless multiplelenses panamic endoscopic system[C]. International Conference on Advanced Engineering They Applications, Springer, 2017: 190200.

    [14] [14] ROSTEN E, DRUMMOND T. Machine learning f highspeed cner detection[C]. 9th European Conference on Computer Vision, Springer, 2006: 430443.

    [15] [15] BAY H, TUYTELAARS T, VAN GOOL L. Surf: Speeded up robust features[C]. 9th European Conference on Computer Vision, Springer, 2006: 404417.

    [16] [16] RUBLEE E, RABAUD V, KONOLIGE K, et al. . B: An efficient alternative to SIFT SURF[C]. International Conference on Computer Vision, Barcelona, 2011: 25642571.

    [17] [17] MUJA M, LOWE D G. Fast approximate nearest neighbs with automatic algithm configuration[C]. Proceedings of the Fourth International Conference on Computer Vision They Applications, INSTICC Press, 2009.

    [19] [19] PENG C H, CHENG C H. A panamic endoscope design implementation f Minimally Invasive Surgery[C]. 2014 IEEE International Symposium on Circuits Systems (ISCAS), IEEE, 2014: 453456.

    [20] CHENG C H, PENG C H, GUO J I, et al. A two-lens minimally invasive surgical panoramic endoscope design and implementation[J]. International Journal of Electrical Engineering, 21, 235-241(2014).

    [21] [21] CHENG C H, HUNG SH P, GUO J I, et al. . A wireless panamic endoscope system design implementation f minimally invasive surgery[C]. 2015 IEEE International Symposium on Circuits Systems (ISCAS), IEEE, 2015: 18951895.

    [22] [22] KIM D T, CHENG C H. A panamic stitching vision perfmance improvement technique f Minimally Invasive Surgery[C]. 2016 5th International Symposium on NextGeneration Electronics (ISNE), IEEE, 2016: 12.

    [23] KIM D T, NGUYEN V T, CHENG C H, et al. Speed improvement in image stitching for panoramic dynamic images during minimally invasive surgery[J]. Journal of Healthcare Engineering, 2018, 3654210(2018).

    [25] KIM D T, CHENG C H, LIU D G, et al. Performance improvement for two-lens panoramic endoscopic system during minimally invasive surgery[J]. Journal of Healthcare Engineering, 2019, 2097284(2019).

    [28] [28] JANG J, YOO H J. A capsule endoscope system f wide visualization field location tracking[C]. 2018 IEEE Biomedical Circuits Systems Conference (BioCAS), IEEE, 2018: 14.

    [30] [30] JANG J, LEE J, LEE K R, et al. . 4Camera VGAresolution capsule endoscope with 80 MBs bodychannel communication transceiver Subcm range capsule localization[C]. 2018 IEEE International Solid State Circuits Conference (ISSCC), IEEE, 2018: 282284.

    [35] SAHLI S, WANG R C C, MURTHY A, et al. A 360 degree side view endoscope for lower GI tract mapping[J]. Physics in Canada, 71, 18-20(2015).

    [37] [37] TSENG S M, HUANG C W, HSU Y T, et al. . Panamic annular lens design of endoscope[C]. 2017 IEEE International Conference on Consumer ElectronicsTaiwan (ICCETW), IEEE, 2017: 101102.

    [38] TSENG S M, YU J C, HSU Y T, et al. Panoramic endoscope based on convex parabolic mirrors[J]. Optical Engineering, 57, 033102(2018).

    [39] TSENG Y C, HAN P, HSU H C, et al. A flexible FOV capsule endoscope design based on compound lens[J]. Journal of Display Technology, 12, 1798-1804(2016).

    [42] [42] PENNE J, HLLER K, STRMER M, et al. . Timeofflight 3D endoscopy[C]. 12th International Conference on Medical Image Computing ComputerAssisted Intervention, Springer, 2009: 467474.

    [43] [43] KHLER T, HAASE S, BAUER S, et al. . ToF meets RGB: novel multisens superresolution f hybrid 3D endoscopy[C]. 16th International Conference on Medical Image Computing ComputerAssisted Intervention, 2013: 139146.

    [44] STOLYAROV R, BUHARIN V, VAL M, et al. Sub-millimeter precision 3D measurement through a standard endoscope with time of flight[J]. Proceedings of SPIE, 11949, 119490E(2022).

    [45] [45] ISHII I, YAMAMOTO K,DOI K, et al.. Highspeed 3D image acquisition using coded structured light projection[C]. 2007 IEEERSJ International Conference on Intelligent Robots Systems, IEEE, 2007: 925930.

    [46] [46] ZHU G J. Research on threedimensional measurement endoscope system based on phaseshifting structure light[D]. Hangzhou: Zhejiang University, 2018. (in Chinese)

    [50] HEIKE C L, UPSON K, STUHAUG E, et al. 3D digital stereophotogrammetry: a practical guide to facial image acquisition[J]. Head & Face Medicine, 6, 18(2010).

    [51] [51] MAURICE X, ALBITAR C, DOIGNON C, et al. . A structured lightbased laparoscope with realtime gans'' surface reconstruction f minimally invasive surgery[C]. 2012 Annual International Conference of the IEEE Engineering in Medicine Biology Society, IEEE, 2012: 57695772.

    [53] [53] DESJARDINS D, PAYEUR P. Dense stereo range sensing with marching pseudorom patterns[C]. Fourth Canadian Conference on Computer Robot Vision (CRV''07), IEEE, 2007: 216226.

    [56] [56] STOYANOV D, YANG G ZH. Soft tissue defmation tracking f robotic assisted minimally invasive surgery[C]. 2009 Annual International Conference of the IEEE Engineering in Medicine Biology Society, IEEE, 2009: 254257.

    [57] HIRSCHMULLER H. Stereo processing by semiglobal matching and mutual information[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 328-341(2007).

    [58] [58] KHAMIS S, FANELLO S, RHEMANN C, et al. . Stereo: Guided hierarchical refinement f realtime edgeaware depth prediction[C]. 15th Proceedings of the European Conference on Computer Vision (ECCV), Springer, 2018: 573590.

    [59] YU H, ZHOU CH J, ZHANG W, et al. A three-dimensional measurement method for binocular endoscopes based on deep learning[J]. Frontiers of Information Technology & Electronic Engineering, 23, 653-660(2022).

    [62] [62] MURARTAL R, TARDS J D. BSLAM: tracking mapping recognizable features[C]. Wkshop on Multi View Geometry in Robotics (MVIGRO), 2014: 2.

    [65] [65] WHELAN T, LEUTENEGGER S, SALASMENO R, et al. . ElasticFusion: Dense SLAM without a pose graph[C]. Robotics: Science Systems XI, 2015.

    [66] DOCEA R, PFEIFFER M, BODENSTEDT S, et al. Simultaneous localisation and mapping for laparoscopic liver navigation: a comparative evaluation study[J]. Proceedings of SPIE, 11598, 115980B(2021).

    [68] [68] NEWCOMBE R A, LOVEGROVE S J, DAVISON A J. DTAM: Dense tracking mapping in realtime[C]. 2011 International Conference on Computer Vision, IEEE, 2011: 23202327.

    [69] [69] ENGEL J, STURM J, CREMERS D. Semidense visual odometry f a monocular camera[C]. Proceedings of the IEEE International Conference on Computer Vision, IEEE, 2013: 14491456.

    [70] [70] CHEN R J, BOBROW T L, ATHEY T, et al. . Slam endoscopy enhanced by adversarial depth prediction[Z]. arXiv preprint arXiv: 1907.00283, 2019.

    [71] WIDYA A R, MONNO Y, OKUTOMI M, et al. Whole stomach 3D reconstruction and frame localization from monocular endoscope video[J]. IEEE Journal of Translational Engineering in Health and Medicine, 7, 1-10(2019).

    [72] [72] TONTINI G E, CAVALLARO F, NEUMANN H, et al. . Extensive smallbowel Crohn’s disease detected by the newly introduced 360° panamic viewing capsule endoscopy system[J]. Endoscopy, 2014, 46(S 01): E353E354.

    [76] RUBIN M, BOSE K P, KIM S H. Mo1517 successful deployment and use of third eye panoramic™ a novel side viewing video CAP fitted on a standard colonoscope[J]. Gastrointestinal Endoscopy, 79, AB466(2014).

    CLP Journals

    [1] Hong-bo ZOU, Biao ZHANG, Zi-chuan WANG, Ke CHEN, Li-qiang WANG, Bo YUAN. Non-uniform illumination correction algorithm for cytoendoscopy images based on illumination model[J]. Chinese Optics, 2024, 17(1): 160

    Tools

    Get Citation

    Copy Citation Text

    Jia-yi HUO, Mian-hao LI, Zi-chuan WANG, Bo YUAN, Qing YANG, Li-qiang WANG. Panoramic endoscopic imaging technology and it’s applications[J]. Chinese Optics, 2023, 16(1): 44

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Review

    Received: Apr. 20, 2022

    Accepted: --

    Published Online: Jul. 5, 2023

    The Author Email:

    DOI:10.37188/CO.2022-0074

    Topics