Towards a clinical stereoscopic augmented reality system for laparoscopic surgery

Xin Kang, Jihun Oh, Emmanuel Wilson, Ziv Yaniv, Timothy D. Kane, Craig A Peters, Raj Shekhar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations

Abstract

We describe our development of a complete real-time stereoscopic augmented reality system that overlays laparoscopic ultrasound (LUS) images on stereoscopic laparoscopic video for conventional laparoscopic surgery. The system was designed and developed to achieve near-term clinical evaluation as a primary goal. Special consideration was paid to system interactivity, accuracy and easy integration within the existing clinical workflow. Custom-designed fixtures for the two imaging devices were created to avoid their recalibration in the operating room and thus to minimize setup time. The system was assembled on a rolling cart to make it portable for the use in the operating room. Utilizing our optimized design and hardware-accelerated implementation, the system achieved a low system latency of approximately 150 ms. The LUS image-to-video registration accuracy, measured in terms of target registration accuracy and recorded separately for the left and right eye channels of the stereoscopic camera, was 3.34±0.59 mm and 2.76±0.68 mm.

Original languageEnglish (US)
Title of host publicationClinical Image-Based Procedures
Subtitle of host publicationTranslational Research in Medical Imaging - Second International Workshop, CLIP 2013, Held in Conjunction with MICCAI 2013, Revised Selected Papers
PublisherSpringer Verlag
Pages108-116
Number of pages9
Volume8361 LNCS
ISBN (Print)9783319056654
DOIs
Publication statusPublished - Jan 1 2014
Event2nd International Workshop on Clinical Image-Based Procedures: Translational Research in Medical Imaging, CLIP 2013 - Held in Conjunction with MICCAI 2013 - Nagoya, Japan
Duration: Sep 22 2013Sep 22 2013

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8361 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other2nd International Workshop on Clinical Image-Based Procedures: Translational Research in Medical Imaging, CLIP 2013 - Held in Conjunction with MICCAI 2013
CountryJapan
CityNagoya
Period9/22/139/22/13

    Fingerprint

Keywords

  • Clinical prototype
  • Laparoscopic surgery
  • Real-time AR
  • Stereoscopic augmented reality (AR)

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Kang, X., Oh, J., Wilson, E., Yaniv, Z., Kane, T. D., Peters, C. A., & Shekhar, R. (2014). Towards a clinical stereoscopic augmented reality system for laparoscopic surgery. In Clinical Image-Based Procedures: Translational Research in Medical Imaging - Second International Workshop, CLIP 2013, Held in Conjunction with MICCAI 2013, Revised Selected Papers (Vol. 8361 LNCS, pp. 108-116). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8361 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-05666-1_14