Virtepex: Virtual Remote Tele-Physical Examination System

Ninad Khargonkar, Kevin Desai, Balakrishnan Prabhakaran, Thiru Annaswamy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Remote strength assessment is critical for providing accessible rehabilitation, especially in the absence of in-person meetings due to the pandemic. In this paper, we introduce "Virtepex", an immersive exergame for remote strength assessment developed through participatory design principles. We bring out the design process starting with a needs assessment to highlight the challenges for physicians in telehealth, followed by the expert guidelines for iterative system refinement. Virtepex addresses the challenges for remote strength assessment through a marker-less and an easy-to-setup strength estimation pipeline. It utilizes an RGB-D camera for motion tracking and an inverse dynamics module for force estimation. The force estimates are used for VR object interaction and can be assessed by a physician synchronously or asynchronously for an objective evaluation. Validation by external experts shows that Virtepex produces reliable force estimates for upper body joints, indicating the potential of marker-less force estimation for future remote assessment designs.

Original languageEnglish (US)
Title of host publicationDIS 2022 - Proceedings of the 2022 ACM Designing Interactive Systems Conference
Subtitle of host publicationDigital Wellbeing
PublisherAssociation for Computing Machinery, Inc
Pages1729-1742
Number of pages14
ISBN (Electronic)9781450393584
DOIs
StatePublished - Jun 13 2022
Externally publishedYes
Event2022 ACM Designing Interactive Systems Conference: Digital Wellbeing, DIS 2022 - Virtual, Online, Australia
Duration: Jun 13 2022Jun 17 2022

Publication series

NameDIS 2022 - Proceedings of the 2022 ACM Designing Interactive Systems Conference: Digital Wellbeing

Conference

Conference2022 ACM Designing Interactive Systems Conference: Digital Wellbeing, DIS 2022
Country/TerritoryAustralia
CityVirtual, Online
Period6/13/226/17/22

Keywords

  • Clinical Health
  • Force Estimation
  • Marker-Less Method
  • Mixed Reality
  • Participatory design.
  • Tele-Medicine

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Fingerprint

Dive into the research topics of 'Virtepex: Virtual Remote Tele-Physical Examination System'. Together they form a unique fingerprint.

Cite this