Quantifying and improving user quality of experience in immersive tele-rehabilitation

Karthik Venkatraman, Suraj Raghuraman, Yuan Tian, Balakrishnan Prabhakaran, Klara Nahrstedt, Thiru Annaswamy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

3D Tele-Immersion (3DTI) environments are emerging as a new medium for human interactions and collaborations in the areas of education, sports training, physical medicine and rehabilitation. By adding a tactile element to a visually centered 3DTI environment, such applications can be made even more engaging. But it also opens up a few challenges in terms of fusing the visual and tactile data streams in a synchronous way. In this paper we describe a 3DTI Tele-Rehabilitation system with Microsoft Kinect cameras and hap tic devices. We describe some of the challenges we face in providing as well as quantifying a good quality of experience (QoE) in this system. We propose a set of solutions that: (i) improve the user's QoE (by using multi-modal prediction for handling latencies, better synchronization that accounts for the global state of the system, etc.), (ii) quantify the QoE (by designing a controlled virtual environment and by defining appropriate user QoE metrics for immersive tele-rehabilitation). The experimental results show a marked improvement in the performance of the system, consequently improving the user-experience. This is also verified by the results of the user performance study.

Original languageEnglish (US)
Title of host publicationProceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages207-214
Number of pages8
ISBN (Print)9781479943111
DOIs
StatePublished - Feb 5 2015
Event16th IEEE International Symposium on Multimedia, ISM 2014 - Taichung, Taiwan, Province of China
Duration: Dec 10 2014Dec 12 2014

Other

Other16th IEEE International Symposium on Multimedia, ISM 2014
CountryTaiwan, Province of China
CityTaichung
Period12/10/1412/12/14

Fingerprint

Patient rehabilitation
Sports
Virtual reality
Medicine
Synchronization
Education
Cameras

Keywords

  • Haptic
  • Metrics
  • Performance
  • Tele-Immersion
  • User Experience

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction
  • Software
  • Media Technology

Cite this

Venkatraman, K., Raghuraman, S., Tian, Y., Prabhakaran, B., Nahrstedt, K., & Annaswamy, T. (2015). Quantifying and improving user quality of experience in immersive tele-rehabilitation. In Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014 (pp. 207-214). [7033022] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISM.2014.64

Quantifying and improving user quality of experience in immersive tele-rehabilitation. / Venkatraman, Karthik; Raghuraman, Suraj; Tian, Yuan; Prabhakaran, Balakrishnan; Nahrstedt, Klara; Annaswamy, Thiru.

Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014. Institute of Electrical and Electronics Engineers Inc., 2015. p. 207-214 7033022.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Venkatraman, K, Raghuraman, S, Tian, Y, Prabhakaran, B, Nahrstedt, K & Annaswamy, T 2015, Quantifying and improving user quality of experience in immersive tele-rehabilitation. in Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014., 7033022, Institute of Electrical and Electronics Engineers Inc., pp. 207-214, 16th IEEE International Symposium on Multimedia, ISM 2014, Taichung, Taiwan, Province of China, 12/10/14. https://doi.org/10.1109/ISM.2014.64
Venkatraman K, Raghuraman S, Tian Y, Prabhakaran B, Nahrstedt K, Annaswamy T. Quantifying and improving user quality of experience in immersive tele-rehabilitation. In Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014. Institute of Electrical and Electronics Engineers Inc. 2015. p. 207-214. 7033022 https://doi.org/10.1109/ISM.2014.64
Venkatraman, Karthik ; Raghuraman, Suraj ; Tian, Yuan ; Prabhakaran, Balakrishnan ; Nahrstedt, Klara ; Annaswamy, Thiru. / Quantifying and improving user quality of experience in immersive tele-rehabilitation. Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 207-214
@inproceedings{2971a8325adf4b9faec573d55124b1b1,
title = "Quantifying and improving user quality of experience in immersive tele-rehabilitation",
abstract = "3D Tele-Immersion (3DTI) environments are emerging as a new medium for human interactions and collaborations in the areas of education, sports training, physical medicine and rehabilitation. By adding a tactile element to a visually centered 3DTI environment, such applications can be made even more engaging. But it also opens up a few challenges in terms of fusing the visual and tactile data streams in a synchronous way. In this paper we describe a 3DTI Tele-Rehabilitation system with Microsoft Kinect cameras and hap tic devices. We describe some of the challenges we face in providing as well as quantifying a good quality of experience (QoE) in this system. We propose a set of solutions that: (i) improve the user's QoE (by using multi-modal prediction for handling latencies, better synchronization that accounts for the global state of the system, etc.), (ii) quantify the QoE (by designing a controlled virtual environment and by defining appropriate user QoE metrics for immersive tele-rehabilitation). The experimental results show a marked improvement in the performance of the system, consequently improving the user-experience. This is also verified by the results of the user performance study.",
keywords = "Haptic, Metrics, Performance, Tele-Immersion, User Experience",
author = "Karthik Venkatraman and Suraj Raghuraman and Yuan Tian and Balakrishnan Prabhakaran and Klara Nahrstedt and Thiru Annaswamy",
year = "2015",
month = "2",
day = "5",
doi = "10.1109/ISM.2014.64",
language = "English (US)",
isbn = "9781479943111",
pages = "207--214",
booktitle = "Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Quantifying and improving user quality of experience in immersive tele-rehabilitation

AU - Venkatraman, Karthik

AU - Raghuraman, Suraj

AU - Tian, Yuan

AU - Prabhakaran, Balakrishnan

AU - Nahrstedt, Klara

AU - Annaswamy, Thiru

PY - 2015/2/5

Y1 - 2015/2/5

N2 - 3D Tele-Immersion (3DTI) environments are emerging as a new medium for human interactions and collaborations in the areas of education, sports training, physical medicine and rehabilitation. By adding a tactile element to a visually centered 3DTI environment, such applications can be made even more engaging. But it also opens up a few challenges in terms of fusing the visual and tactile data streams in a synchronous way. In this paper we describe a 3DTI Tele-Rehabilitation system with Microsoft Kinect cameras and hap tic devices. We describe some of the challenges we face in providing as well as quantifying a good quality of experience (QoE) in this system. We propose a set of solutions that: (i) improve the user's QoE (by using multi-modal prediction for handling latencies, better synchronization that accounts for the global state of the system, etc.), (ii) quantify the QoE (by designing a controlled virtual environment and by defining appropriate user QoE metrics for immersive tele-rehabilitation). The experimental results show a marked improvement in the performance of the system, consequently improving the user-experience. This is also verified by the results of the user performance study.

AB - 3D Tele-Immersion (3DTI) environments are emerging as a new medium for human interactions and collaborations in the areas of education, sports training, physical medicine and rehabilitation. By adding a tactile element to a visually centered 3DTI environment, such applications can be made even more engaging. But it also opens up a few challenges in terms of fusing the visual and tactile data streams in a synchronous way. In this paper we describe a 3DTI Tele-Rehabilitation system with Microsoft Kinect cameras and hap tic devices. We describe some of the challenges we face in providing as well as quantifying a good quality of experience (QoE) in this system. We propose a set of solutions that: (i) improve the user's QoE (by using multi-modal prediction for handling latencies, better synchronization that accounts for the global state of the system, etc.), (ii) quantify the QoE (by designing a controlled virtual environment and by defining appropriate user QoE metrics for immersive tele-rehabilitation). The experimental results show a marked improvement in the performance of the system, consequently improving the user-experience. This is also verified by the results of the user performance study.

KW - Haptic

KW - Metrics

KW - Performance

KW - Tele-Immersion

KW - User Experience

UR - http://www.scopus.com/inward/record.url?scp=84930447883&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84930447883&partnerID=8YFLogxK

U2 - 10.1109/ISM.2014.64

DO - 10.1109/ISM.2014.64

M3 - Conference contribution

AN - SCOPUS:84930447883

SN - 9781479943111

SP - 207

EP - 214

BT - Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014

PB - Institute of Electrical and Electronics Engineers Inc.

ER -