TY - GEN
T1 - H-TIME
T2 - 25th ACM International Conference on Multimedia, MM 2017
AU - Tian, Yuan
AU - Raghuraman, Suraj
AU - Annaswamy, Thiru
AU - Borresenr, Aleksander
AU - Nahrstedt, Klara
AU - Prabhakaran, Balakrishnan
N1 - Funding Information:
We have proposed the H-TIME system, which provides a 3D immersive tactile environment for remote musculoskeletal examination. A high degree of correlation was found, when the in-person and H-TIME evaluation of the patients were analyzed. This high correlation highlight the usefulness and potential of the proposed H-TIME system. Based on the feedback from doctors and patients, some of insights and future work are shown as follows: Haptic Device: Due to the small size of the haptic device, the range of motion is very restricted. A higher maximum force, of 50lbs or more, would be better. Having various types of handles for the haptic device would expand its uses, and its ability to help even more people. More Cameras: The use of only two cameras is not sufficient to generate a complete 360◦ view of the person, so there are plenty of artifacts making it difficult to evaluate. 3 or more cameras can be introduced [31]. Visuo-Haptic Disparity: In this paper, the delay between 3D data and haptic is around 500 ms, which is relatively low to generate large disparity. Furthermore, since the range of motion is limited, there are little artifacts of mesh interpolation. In the future, we will discuss whether the handling technique would have affected the evaluations when dealing with larger delay and bigger range of motion. Patient Trials: The patient trials can be expanded by involving multiple doctors, and using the system over a longer period to investigate the experience over time. ACKNOWLEDGEMENTS This material is based upon work supported by the National Science Foundation (NSF) under Grant No. 1012975 and US Army Research Office (ARO) Grant W911NF-17-1-0299 and ARO’s STIR (Short Term Innovative Research) Grant W911NF-16-1-0163. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the NSF and ARO.
Funding Information:
This material is based upon work supported by the National Science Foundation (NSF) under Grant No. 1012975 and US Army Research Office (ARO) Grant W911NF-17-1-0299 and ARO's STIR (Short Term Innovative Research) Grant W911NF-16-1-0163. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the NSF and ARO.
PY - 2017/10/23
Y1 - 2017/10/23
N2 - The current state-of-the-art tele-medicine applications only allow audiovisual communication between a doctor and the patient, necessitating a clinician to physically examine the patient. The doctor relies on the physical examination performed by the clinician, along with the audiovisual dialogue with the patient. In this paper, a Haptic-enabled Tele-Immersive Musculoskeletal Examination (H-TIME) system is introduced, that allows doctors to physically examine musculoskeletal conditions of the patients remotely, by looking at the 3D reconstructed model of the patient in the virtual world, and physically feeling the patient's range of mobility using a haptic device. The proposed bidirectional haptic rendering in H-TIME can allow the doctor to evaluate a patient who suffers from problems in their upper extremities, such as the shoulder, elbow, wrist, etc., and evaluate them remotely. Real world user study was performed, between the doctors and the patients, and it highlighted the potential of the proposed system. The study indicated a high degree of correlation between the in-person and H-TIME evaluations of the patient. Both the doctors and patients involved in the study, felt that the system could potentially replace in-person consultations, someday.
AB - The current state-of-the-art tele-medicine applications only allow audiovisual communication between a doctor and the patient, necessitating a clinician to physically examine the patient. The doctor relies on the physical examination performed by the clinician, along with the audiovisual dialogue with the patient. In this paper, a Haptic-enabled Tele-Immersive Musculoskeletal Examination (H-TIME) system is introduced, that allows doctors to physically examine musculoskeletal conditions of the patients remotely, by looking at the 3D reconstructed model of the patient in the virtual world, and physically feeling the patient's range of mobility using a haptic device. The proposed bidirectional haptic rendering in H-TIME can allow the doctor to evaluate a patient who suffers from problems in their upper extremities, such as the shoulder, elbow, wrist, etc., and evaluate them remotely. Real world user study was performed, between the doctors and the patients, and it highlighted the potential of the proposed system. The study indicated a high degree of correlation between the in-person and H-TIME evaluations of the patient. Both the doctors and patients involved in the study, felt that the system could potentially replace in-person consultations, someday.
KW - 3D tele-immersion
KW - Haptics
KW - Mixed reality
KW - Physiotherapy
KW - Tele-medicine
UR - http://www.scopus.com/inward/record.url?scp=85035220605&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85035220605&partnerID=8YFLogxK
U2 - 10.1145/3123266.3123395
DO - 10.1145/3123266.3123395
M3 - Conference contribution
AN - SCOPUS:85035220605
T3 - MM 2017 - Proceedings of the 2017 ACM Multimedia Conference
SP - 137
EP - 145
BT - MM 2017 - Proceedings of the 2017 ACM Multimedia Conference
PB - Association for Computing Machinery, Inc
Y2 - 23 October 2017 through 27 October 2017
ER -