Mr.MAPP: Mixed reality for MAnaging phantom pain

Kanchan Bahirat, Thiru Annaswamy, Balakrishnan Prabhakaran

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Phantom Limb Pain or simply, Phantom Pain is a severe chronic pain that is experienced as a vivid sensation of the pain in missing body part. Epidemiological studies obtained from a large samples indicate that the short-term incidence rate of the phantom limb pain is 72% [13], while long-term incidence rate (6 months after amputation) is 67% [5, 13]. A wide spectrum of treatments developed for alleviating phantom limb pain includes the traditional mirror box therapy as well as recently developed virtual reality-based methods. Most of the virtual reality-based methods rely on 3D CAD models of the virtual limb, animating them using the motion data acquired either from patient's existing anatomical limb or myoelectric activity at patient's stump (of the amputated limb). Since motion activity is typically captured using body sensors (Electromyography, EMG, or inertial sensors), these methods are considered as invasive approaches. Further, in the case of virtual reality-based methods, the dependency on the pre-built 3D models degrades the immersive experience due to a mismatch in the skin color, clothes, artificial and rigid look and misalignment of the phantom limb. In this work, we propose a novel Mixed Reality based system for MAnaging Phantom Pain (Mr.MAPP), utilizing off-the-shelf RGB-D cameras such as Microsoft Kinect V2 to capture and generate a 3D model of the patient in real-time. An illusion of the virtual limb is crafted in real-time by mirroring the patient's symmetric anatomical limb in the captured data with the help of various computer vision and graphics techniques. Along with that, a phantom limb skeleton is also generated in real-time to enable interaction with virtual objects. We conducted a multi-pronged user Quality of Experience (QoE) study of Mr.MAPP employing various rendering displays such as 3D Television, and Head mounted displays (Oculus Rift, Samsung Gear VR). The user study involved two classes of users: (a) a big pool of Subject-Matter Experts (SMEs) that includes Physical Medicine and Rehab (PM&R) experts, Amputee Occupational Therapist and Doctors of Chiropractic; (b) healthy non-expert users. SMEs, as well as the healthy non-expert users provided a very positive feedback of Mr.MAPP indicating the potential value of Mr.MAPP for the phantom pain management.

Original languageEnglish (US)
Title of host publicationMM 2017 - Proceedings of the 2017 ACM Multimedia Conference
PublisherAssociation for Computing Machinery, Inc
Pages1558-1566
Number of pages9
ISBN (Electronic)9781450349062
DOIs
StatePublished - Oct 23 2017
Event25th ACM International Conference on Multimedia, MM 2017 - Mountain View, United States
Duration: Oct 23 2017Oct 27 2017

Other

Other25th ACM International Conference on Multimedia, MM 2017
CountryUnited States
CityMountain View
Period10/23/1710/27/17

Fingerprint

Virtual reality
Display devices
Electromyography
Sensors
Computer graphics
Television
Computer vision
Medicine
Gears
Computer aided design
Skin
Mirrors
Cameras
Color
Feedback

Keywords

  • Augmented virtuality
  • Mixed reality
  • Phantom pain management

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Media Technology
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Bahirat, K., Annaswamy, T., & Prabhakaran, B. (2017). Mr.MAPP: Mixed reality for MAnaging phantom pain. In MM 2017 - Proceedings of the 2017 ACM Multimedia Conference (pp. 1558-1566). Association for Computing Machinery, Inc. https://doi.org/10.1145/3123266.3123419

Mr.MAPP : Mixed reality for MAnaging phantom pain. / Bahirat, Kanchan; Annaswamy, Thiru; Prabhakaran, Balakrishnan.

MM 2017 - Proceedings of the 2017 ACM Multimedia Conference. Association for Computing Machinery, Inc, 2017. p. 1558-1566.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Bahirat, K, Annaswamy, T & Prabhakaran, B 2017, Mr.MAPP: Mixed reality for MAnaging phantom pain. in MM 2017 - Proceedings of the 2017 ACM Multimedia Conference. Association for Computing Machinery, Inc, pp. 1558-1566, 25th ACM International Conference on Multimedia, MM 2017, Mountain View, United States, 10/23/17. https://doi.org/10.1145/3123266.3123419
Bahirat K, Annaswamy T, Prabhakaran B. Mr.MAPP: Mixed reality for MAnaging phantom pain. In MM 2017 - Proceedings of the 2017 ACM Multimedia Conference. Association for Computing Machinery, Inc. 2017. p. 1558-1566 https://doi.org/10.1145/3123266.3123419
Bahirat, Kanchan ; Annaswamy, Thiru ; Prabhakaran, Balakrishnan. / Mr.MAPP : Mixed reality for MAnaging phantom pain. MM 2017 - Proceedings of the 2017 ACM Multimedia Conference. Association for Computing Machinery, Inc, 2017. pp. 1558-1566
@inproceedings{e6f36769d9b84deaaddf552d3541f22a,
title = "Mr.MAPP: Mixed reality for MAnaging phantom pain",
abstract = "Phantom Limb Pain or simply, Phantom Pain is a severe chronic pain that is experienced as a vivid sensation of the pain in missing body part. Epidemiological studies obtained from a large samples indicate that the short-term incidence rate of the phantom limb pain is 72{\%} [13], while long-term incidence rate (6 months after amputation) is 67{\%} [5, 13]. A wide spectrum of treatments developed for alleviating phantom limb pain includes the traditional mirror box therapy as well as recently developed virtual reality-based methods. Most of the virtual reality-based methods rely on 3D CAD models of the virtual limb, animating them using the motion data acquired either from patient's existing anatomical limb or myoelectric activity at patient's stump (of the amputated limb). Since motion activity is typically captured using body sensors (Electromyography, EMG, or inertial sensors), these methods are considered as invasive approaches. Further, in the case of virtual reality-based methods, the dependency on the pre-built 3D models degrades the immersive experience due to a mismatch in the skin color, clothes, artificial and rigid look and misalignment of the phantom limb. In this work, we propose a novel Mixed Reality based system for MAnaging Phantom Pain (Mr.MAPP), utilizing off-the-shelf RGB-D cameras such as Microsoft Kinect V2 to capture and generate a 3D model of the patient in real-time. An illusion of the virtual limb is crafted in real-time by mirroring the patient's symmetric anatomical limb in the captured data with the help of various computer vision and graphics techniques. Along with that, a phantom limb skeleton is also generated in real-time to enable interaction with virtual objects. We conducted a multi-pronged user Quality of Experience (QoE) study of Mr.MAPP employing various rendering displays such as 3D Television, and Head mounted displays (Oculus Rift, Samsung Gear VR). The user study involved two classes of users: (a) a big pool of Subject-Matter Experts (SMEs) that includes Physical Medicine and Rehab (PM&R) experts, Amputee Occupational Therapist and Doctors of Chiropractic; (b) healthy non-expert users. SMEs, as well as the healthy non-expert users provided a very positive feedback of Mr.MAPP indicating the potential value of Mr.MAPP for the phantom pain management.",
keywords = "Augmented virtuality, Mixed reality, Phantom pain management",
author = "Kanchan Bahirat and Thiru Annaswamy and Balakrishnan Prabhakaran",
year = "2017",
month = "10",
day = "23",
doi = "10.1145/3123266.3123419",
language = "English (US)",
pages = "1558--1566",
booktitle = "MM 2017 - Proceedings of the 2017 ACM Multimedia Conference",
publisher = "Association for Computing Machinery, Inc",

}

TY - GEN

T1 - Mr.MAPP

T2 - Mixed reality for MAnaging phantom pain

AU - Bahirat, Kanchan

AU - Annaswamy, Thiru

AU - Prabhakaran, Balakrishnan

PY - 2017/10/23

Y1 - 2017/10/23

N2 - Phantom Limb Pain or simply, Phantom Pain is a severe chronic pain that is experienced as a vivid sensation of the pain in missing body part. Epidemiological studies obtained from a large samples indicate that the short-term incidence rate of the phantom limb pain is 72% [13], while long-term incidence rate (6 months after amputation) is 67% [5, 13]. A wide spectrum of treatments developed for alleviating phantom limb pain includes the traditional mirror box therapy as well as recently developed virtual reality-based methods. Most of the virtual reality-based methods rely on 3D CAD models of the virtual limb, animating them using the motion data acquired either from patient's existing anatomical limb or myoelectric activity at patient's stump (of the amputated limb). Since motion activity is typically captured using body sensors (Electromyography, EMG, or inertial sensors), these methods are considered as invasive approaches. Further, in the case of virtual reality-based methods, the dependency on the pre-built 3D models degrades the immersive experience due to a mismatch in the skin color, clothes, artificial and rigid look and misalignment of the phantom limb. In this work, we propose a novel Mixed Reality based system for MAnaging Phantom Pain (Mr.MAPP), utilizing off-the-shelf RGB-D cameras such as Microsoft Kinect V2 to capture and generate a 3D model of the patient in real-time. An illusion of the virtual limb is crafted in real-time by mirroring the patient's symmetric anatomical limb in the captured data with the help of various computer vision and graphics techniques. Along with that, a phantom limb skeleton is also generated in real-time to enable interaction with virtual objects. We conducted a multi-pronged user Quality of Experience (QoE) study of Mr.MAPP employing various rendering displays such as 3D Television, and Head mounted displays (Oculus Rift, Samsung Gear VR). The user study involved two classes of users: (a) a big pool of Subject-Matter Experts (SMEs) that includes Physical Medicine and Rehab (PM&R) experts, Amputee Occupational Therapist and Doctors of Chiropractic; (b) healthy non-expert users. SMEs, as well as the healthy non-expert users provided a very positive feedback of Mr.MAPP indicating the potential value of Mr.MAPP for the phantom pain management.

AB - Phantom Limb Pain or simply, Phantom Pain is a severe chronic pain that is experienced as a vivid sensation of the pain in missing body part. Epidemiological studies obtained from a large samples indicate that the short-term incidence rate of the phantom limb pain is 72% [13], while long-term incidence rate (6 months after amputation) is 67% [5, 13]. A wide spectrum of treatments developed for alleviating phantom limb pain includes the traditional mirror box therapy as well as recently developed virtual reality-based methods. Most of the virtual reality-based methods rely on 3D CAD models of the virtual limb, animating them using the motion data acquired either from patient's existing anatomical limb or myoelectric activity at patient's stump (of the amputated limb). Since motion activity is typically captured using body sensors (Electromyography, EMG, or inertial sensors), these methods are considered as invasive approaches. Further, in the case of virtual reality-based methods, the dependency on the pre-built 3D models degrades the immersive experience due to a mismatch in the skin color, clothes, artificial and rigid look and misalignment of the phantom limb. In this work, we propose a novel Mixed Reality based system for MAnaging Phantom Pain (Mr.MAPP), utilizing off-the-shelf RGB-D cameras such as Microsoft Kinect V2 to capture and generate a 3D model of the patient in real-time. An illusion of the virtual limb is crafted in real-time by mirroring the patient's symmetric anatomical limb in the captured data with the help of various computer vision and graphics techniques. Along with that, a phantom limb skeleton is also generated in real-time to enable interaction with virtual objects. We conducted a multi-pronged user Quality of Experience (QoE) study of Mr.MAPP employing various rendering displays such as 3D Television, and Head mounted displays (Oculus Rift, Samsung Gear VR). The user study involved two classes of users: (a) a big pool of Subject-Matter Experts (SMEs) that includes Physical Medicine and Rehab (PM&R) experts, Amputee Occupational Therapist and Doctors of Chiropractic; (b) healthy non-expert users. SMEs, as well as the healthy non-expert users provided a very positive feedback of Mr.MAPP indicating the potential value of Mr.MAPP for the phantom pain management.

KW - Augmented virtuality

KW - Mixed reality

KW - Phantom pain management

UR - http://www.scopus.com/inward/record.url?scp=85035203473&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85035203473&partnerID=8YFLogxK

U2 - 10.1145/3123266.3123419

DO - 10.1145/3123266.3123419

M3 - Conference contribution

AN - SCOPUS:85035203473

SP - 1558

EP - 1566

BT - MM 2017 - Proceedings of the 2017 ACM Multimedia Conference

PB - Association for Computing Machinery, Inc

ER -