The Kinect as an interventional tracking system

Xiang L. Wang, Philipp J. Stolka, Emad Boctor, Gregory Hager, Michael Choti

Research output: Chapter in Book/Report/Conference proceedingConference contribution

15 Citations (Scopus)

Abstract

This work explores the suitability of low-cost sensors for "serious" medical applications, such as tracking of interventional tools in the OR, for simulation, and for education. Although such tracking - i.e. the acquisition of pose data e.g. for ultrasound probes, tissue manipulation tools, needles, but also tissue, bone etc. - is well established, it relies mostly on external devices such as optical or electromagnetic trackers, both of which mandate the use of special markers or sensors attached to each single entity whose pose is to be recorded, and also require their calibration to the tracked entity, i.e. the determination of the geometric relationship between the marker's and the object's intrinsic coordinate frames. The Microsoft Kinect sensor is a recently introduced device for full-body tracking in the gaming market, but it was quickly hacked - due to its wide range of tightly integrated sensors (RGB camera, IR depth and greyscale camera, microphones, accelerometers, and basic actuation) - and used beyond this area. As its field of view and its accuracy are within reasonable usability limits, we describe a medical needle-tracking system for interventional applications based on the Kinect sensor, standard biopsy needles, and no necessary attachments, thus saving both cost and time. Its twin cameras are used as a stereo pair to detect needle-shaped objects, reconstruct their pose in four degrees of freedom, and provide information about the most likely candidate.

Original languageEnglish (US)
Title of host publicationProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume8316
DOIs
StatePublished - 2012
EventMedical Imaging 2012: Image-Guided Procedures, Robotic Interventions, and Modeling - San Diego, CA, United States
Duration: Feb 5 2012Feb 7 2012

Other

OtherMedical Imaging 2012: Image-Guided Procedures, Robotic Interventions, and Modeling
CountryUnited States
CitySan Diego, CA
Period2/5/122/7/12

Fingerprint

Needles
needles
sensors
Sensors
Cameras
cameras
Costs and Cost Analysis
Equipment and Supplies
Electromagnetic Phenomena
markers
Needle Biopsy
Calibration
Tissue
Biopsy
Education
Bone and Bones
Medical applications
accelerometers
Microphones
microphones

Keywords

  • calibration
  • Image-guided
  • interventional
  • Kinect
  • low-cost
  • stereo camera
  • tracking

ASJC Scopus subject areas

  • Atomic and Molecular Physics, and Optics
  • Electronic, Optical and Magnetic Materials
  • Biomaterials
  • Radiology Nuclear Medicine and imaging

Cite this

Wang, X. L., Stolka, P. J., Boctor, E., Hager, G., & Choti, M. (2012). The Kinect as an interventional tracking system. In Progress in Biomedical Optics and Imaging - Proceedings of SPIE (Vol. 8316). [83160U] https://doi.org/10.1117/12.912444

The Kinect as an interventional tracking system. / Wang, Xiang L.; Stolka, Philipp J.; Boctor, Emad; Hager, Gregory; Choti, Michael.

Progress in Biomedical Optics and Imaging - Proceedings of SPIE. Vol. 8316 2012. 83160U.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Wang, XL, Stolka, PJ, Boctor, E, Hager, G & Choti, M 2012, The Kinect as an interventional tracking system. in Progress in Biomedical Optics and Imaging - Proceedings of SPIE. vol. 8316, 83160U, Medical Imaging 2012: Image-Guided Procedures, Robotic Interventions, and Modeling, San Diego, CA, United States, 2/5/12. https://doi.org/10.1117/12.912444
Wang XL, Stolka PJ, Boctor E, Hager G, Choti M. The Kinect as an interventional tracking system. In Progress in Biomedical Optics and Imaging - Proceedings of SPIE. Vol. 8316. 2012. 83160U https://doi.org/10.1117/12.912444
Wang, Xiang L. ; Stolka, Philipp J. ; Boctor, Emad ; Hager, Gregory ; Choti, Michael. / The Kinect as an interventional tracking system. Progress in Biomedical Optics and Imaging - Proceedings of SPIE. Vol. 8316 2012.
@inproceedings{9761f4af2aa340e5a948447c48598b7e,
title = "The Kinect as an interventional tracking system",
abstract = "This work explores the suitability of low-cost sensors for {"}serious{"} medical applications, such as tracking of interventional tools in the OR, for simulation, and for education. Although such tracking - i.e. the acquisition of pose data e.g. for ultrasound probes, tissue manipulation tools, needles, but also tissue, bone etc. - is well established, it relies mostly on external devices such as optical or electromagnetic trackers, both of which mandate the use of special markers or sensors attached to each single entity whose pose is to be recorded, and also require their calibration to the tracked entity, i.e. the determination of the geometric relationship between the marker's and the object's intrinsic coordinate frames. The Microsoft Kinect sensor is a recently introduced device for full-body tracking in the gaming market, but it was quickly hacked - due to its wide range of tightly integrated sensors (RGB camera, IR depth and greyscale camera, microphones, accelerometers, and basic actuation) - and used beyond this area. As its field of view and its accuracy are within reasonable usability limits, we describe a medical needle-tracking system for interventional applications based on the Kinect sensor, standard biopsy needles, and no necessary attachments, thus saving both cost and time. Its twin cameras are used as a stereo pair to detect needle-shaped objects, reconstruct their pose in four degrees of freedom, and provide information about the most likely candidate.",
keywords = "calibration, Image-guided, interventional, Kinect, low-cost, stereo camera, tracking",
author = "Wang, {Xiang L.} and Stolka, {Philipp J.} and Emad Boctor and Gregory Hager and Michael Choti",
year = "2012",
doi = "10.1117/12.912444",
language = "English (US)",
isbn = "9780819489654",
volume = "8316",
booktitle = "Progress in Biomedical Optics and Imaging - Proceedings of SPIE",

}

TY - GEN

T1 - The Kinect as an interventional tracking system

AU - Wang, Xiang L.

AU - Stolka, Philipp J.

AU - Boctor, Emad

AU - Hager, Gregory

AU - Choti, Michael

PY - 2012

Y1 - 2012

N2 - This work explores the suitability of low-cost sensors for "serious" medical applications, such as tracking of interventional tools in the OR, for simulation, and for education. Although such tracking - i.e. the acquisition of pose data e.g. for ultrasound probes, tissue manipulation tools, needles, but also tissue, bone etc. - is well established, it relies mostly on external devices such as optical or electromagnetic trackers, both of which mandate the use of special markers or sensors attached to each single entity whose pose is to be recorded, and also require their calibration to the tracked entity, i.e. the determination of the geometric relationship between the marker's and the object's intrinsic coordinate frames. The Microsoft Kinect sensor is a recently introduced device for full-body tracking in the gaming market, but it was quickly hacked - due to its wide range of tightly integrated sensors (RGB camera, IR depth and greyscale camera, microphones, accelerometers, and basic actuation) - and used beyond this area. As its field of view and its accuracy are within reasonable usability limits, we describe a medical needle-tracking system for interventional applications based on the Kinect sensor, standard biopsy needles, and no necessary attachments, thus saving both cost and time. Its twin cameras are used as a stereo pair to detect needle-shaped objects, reconstruct their pose in four degrees of freedom, and provide information about the most likely candidate.

AB - This work explores the suitability of low-cost sensors for "serious" medical applications, such as tracking of interventional tools in the OR, for simulation, and for education. Although such tracking - i.e. the acquisition of pose data e.g. for ultrasound probes, tissue manipulation tools, needles, but also tissue, bone etc. - is well established, it relies mostly on external devices such as optical or electromagnetic trackers, both of which mandate the use of special markers or sensors attached to each single entity whose pose is to be recorded, and also require their calibration to the tracked entity, i.e. the determination of the geometric relationship between the marker's and the object's intrinsic coordinate frames. The Microsoft Kinect sensor is a recently introduced device for full-body tracking in the gaming market, but it was quickly hacked - due to its wide range of tightly integrated sensors (RGB camera, IR depth and greyscale camera, microphones, accelerometers, and basic actuation) - and used beyond this area. As its field of view and its accuracy are within reasonable usability limits, we describe a medical needle-tracking system for interventional applications based on the Kinect sensor, standard biopsy needles, and no necessary attachments, thus saving both cost and time. Its twin cameras are used as a stereo pair to detect needle-shaped objects, reconstruct their pose in four degrees of freedom, and provide information about the most likely candidate.

KW - calibration

KW - Image-guided

KW - interventional

KW - Kinect

KW - low-cost

KW - stereo camera

KW - tracking

UR - http://www.scopus.com/inward/record.url?scp=84860238293&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84860238293&partnerID=8YFLogxK

U2 - 10.1117/12.912444

DO - 10.1117/12.912444

M3 - Conference contribution

AN - SCOPUS:84860238293

SN - 9780819489654

VL - 8316

BT - Progress in Biomedical Optics and Imaging - Proceedings of SPIE

ER -