Quantifying and improving user quality of experience in immersive tele-rehabilitation

Karthik Venkatraman; Suraj Raghuraman; Yuan Tian; Balakrishnan Prabhakaran; Klara Nahrstedt; Thiru Annaswamy

doi:10.1109/ISM.2014.64

Quantifying and improving user quality of experience in immersive tele-rehabilitation

Karthik Venkatraman, Suraj Raghuraman, Yuan Tian, Balakrishnan Prabhakaran, Klara Nahrstedt, Thiru Annaswamy

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

6 Scopus citations

Abstract

3D Tele-Immersion (3DTI) environments are emerging as a new medium for human interactions and collaborations in the areas of education, sports training, physical medicine and rehabilitation. By adding a tactile element to a visually centered 3DTI environment, such applications can be made even more engaging. But it also opens up a few challenges in terms of fusing the visual and tactile data streams in a synchronous way. In this paper we describe a 3DTI Tele-Rehabilitation system with Microsoft Kinect cameras and hap tic devices. We describe some of the challenges we face in providing as well as quantifying a good quality of experience (QoE) in this system. We propose a set of solutions that: (i) improve the user's QoE (by using multi-modal prediction for handling latencies, better synchronization that accounts for the global state of the system, etc.), (ii) quantify the QoE (by designing a controlled virtual environment and by defining appropriate user QoE metrics for immersive tele-rehabilitation). The experimental results show a marked improvement in the performance of the system, consequently improving the user-experience. This is also verified by the results of the user performance study.

Original language	English (US)
Title of host publication	Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	207-214
Number of pages	8
ISBN (Electronic)	9781479943111
DOIs	https://doi.org/10.1109/ISM.2014.64
State	Published - Feb 5 2015
Event	16th IEEE International Symposium on Multimedia, ISM 2014 - Taichung, Taiwan, Province of China Duration: Dec 10 2014 → Dec 12 2014

Publication series

Name	Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014

Other

Other	16th IEEE International Symposium on Multimedia, ISM 2014
Country/Territory	Taiwan, Province of China
City	Taichung
Period	12/10/14 → 12/12/14

Keywords

Haptic
Metrics
Performance
Tele-Immersion
User Experience

ASJC Scopus subject areas

Computer Graphics and Computer-Aided Design
Computer Vision and Pattern Recognition
Human-Computer Interaction
Software
Media Technology

Access to Document

10.1109/ISM.2014.64

Cite this

Venkatraman, K., Raghuraman, S., Tian, Y., Prabhakaran, B., Nahrstedt, K., & Annaswamy, T. (2015). Quantifying and improving user quality of experience in immersive tele-rehabilitation. In Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014 (pp. 207-214). Article 7033022 (Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISM.2014.64

Quantifying and improving user quality of experience in immersive tele-rehabilitation. / Venkatraman, Karthik; Raghuraman, Suraj; Tian, Yuan et al.
Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014. Institute of Electrical and Electronics Engineers Inc., 2015. p. 207-214 7033022 (Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Venkatraman, K, Raghuraman, S, Tian, Y, Prabhakaran, B, Nahrstedt, K & Annaswamy, T 2015, Quantifying and improving user quality of experience in immersive tele-rehabilitation. in Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014., 7033022, Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014, Institute of Electrical and Electronics Engineers Inc., pp. 207-214, 16th IEEE International Symposium on Multimedia, ISM 2014, Taichung, Taiwan, Province of China, 12/10/14. https://doi.org/10.1109/ISM.2014.64

Venkatraman K, Raghuraman S, Tian Y, Prabhakaran B, Nahrstedt K, Annaswamy T. Quantifying and improving user quality of experience in immersive tele-rehabilitation. In Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014. Institute of Electrical and Electronics Engineers Inc. 2015. p. 207-214. 7033022. (Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014). doi: 10.1109/ISM.2014.64

Venkatraman, Karthik ; Raghuraman, Suraj ; Tian, Yuan et al. / Quantifying and improving user quality of experience in immersive tele-rehabilitation. Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 207-214 (Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014).

@inproceedings{2971a8325adf4b9faec573d55124b1b1,

title = "Quantifying and improving user quality of experience in immersive tele-rehabilitation",

abstract = "3D Tele-Immersion (3DTI) environments are emerging as a new medium for human interactions and collaborations in the areas of education, sports training, physical medicine and rehabilitation. By adding a tactile element to a visually centered 3DTI environment, such applications can be made even more engaging. But it also opens up a few challenges in terms of fusing the visual and tactile data streams in a synchronous way. In this paper we describe a 3DTI Tele-Rehabilitation system with Microsoft Kinect cameras and hap tic devices. We describe some of the challenges we face in providing as well as quantifying a good quality of experience (QoE) in this system. We propose a set of solutions that: (i) improve the user's QoE (by using multi-modal prediction for handling latencies, better synchronization that accounts for the global state of the system, etc.), (ii) quantify the QoE (by designing a controlled virtual environment and by defining appropriate user QoE metrics for immersive tele-rehabilitation). The experimental results show a marked improvement in the performance of the system, consequently improving the user-experience. This is also verified by the results of the user performance study.",

keywords = "Haptic, Metrics, Performance, Tele-Immersion, User Experience",

author = "Karthik Venkatraman and Suraj Raghuraman and Yuan Tian and Balakrishnan Prabhakaran and Klara Nahrstedt and Thiru Annaswamy",

year = "2015",

month = feb,

day = "5",

doi = "10.1109/ISM.2014.64",

language = "English (US)",

series = "Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "207--214",

booktitle = "Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014",

note = "16th IEEE International Symposium on Multimedia, ISM 2014 ; Conference date: 10-12-2014 Through 12-12-2014",

}

TY - GEN

T1 - Quantifying and improving user quality of experience in immersive tele-rehabilitation

AU - Venkatraman, Karthik

AU - Raghuraman, Suraj

AU - Tian, Yuan

AU - Prabhakaran, Balakrishnan

AU - Nahrstedt, Klara

AU - Annaswamy, Thiru

PY - 2015/2/5

Y1 - 2015/2/5

N2 - 3D Tele-Immersion (3DTI) environments are emerging as a new medium for human interactions and collaborations in the areas of education, sports training, physical medicine and rehabilitation. By adding a tactile element to a visually centered 3DTI environment, such applications can be made even more engaging. But it also opens up a few challenges in terms of fusing the visual and tactile data streams in a synchronous way. In this paper we describe a 3DTI Tele-Rehabilitation system with Microsoft Kinect cameras and hap tic devices. We describe some of the challenges we face in providing as well as quantifying a good quality of experience (QoE) in this system. We propose a set of solutions that: (i) improve the user's QoE (by using multi-modal prediction for handling latencies, better synchronization that accounts for the global state of the system, etc.), (ii) quantify the QoE (by designing a controlled virtual environment and by defining appropriate user QoE metrics for immersive tele-rehabilitation). The experimental results show a marked improvement in the performance of the system, consequently improving the user-experience. This is also verified by the results of the user performance study.

AB - 3D Tele-Immersion (3DTI) environments are emerging as a new medium for human interactions and collaborations in the areas of education, sports training, physical medicine and rehabilitation. By adding a tactile element to a visually centered 3DTI environment, such applications can be made even more engaging. But it also opens up a few challenges in terms of fusing the visual and tactile data streams in a synchronous way. In this paper we describe a 3DTI Tele-Rehabilitation system with Microsoft Kinect cameras and hap tic devices. We describe some of the challenges we face in providing as well as quantifying a good quality of experience (QoE) in this system. We propose a set of solutions that: (i) improve the user's QoE (by using multi-modal prediction for handling latencies, better synchronization that accounts for the global state of the system, etc.), (ii) quantify the QoE (by designing a controlled virtual environment and by defining appropriate user QoE metrics for immersive tele-rehabilitation). The experimental results show a marked improvement in the performance of the system, consequently improving the user-experience. This is also verified by the results of the user performance study.

KW - Haptic

KW - Metrics

KW - Performance

KW - Tele-Immersion

KW - User Experience

UR - http://www.scopus.com/inward/record.url?scp=84930447883&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84930447883&partnerID=8YFLogxK

U2 - 10.1109/ISM.2014.64

DO - 10.1109/ISM.2014.64

M3 - Conference contribution

AN - SCOPUS:84930447883

T3 - Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014

SP - 207

EP - 214

BT - Proceedings - 2014 IEEE International Symposium on Multimedia, ISM 2014

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 16th IEEE International Symposium on Multimedia, ISM 2014

Y2 - 10 December 2014 through 12 December 2014

ER -

Quantifying and improving user quality of experience in immersive tele-rehabilitation

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this