Meaningful assessment of surgical expertise: Semantic labeling with data and crowds

Marzieh Ershad, Zachary Koesters, Robert V Rege, Ann Majewicz

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

Many surgical assessment metrics have been developed to identify and rank surgical expertise; however,some of these metrics (e.g.,economy of motion) can be difficult to understand and do not coach the user on how to modify behavior. We aim to standardize assessment language by identifying key semantic labels for expertise. We chose six pairs of contrasting adjectives and associated a metric with each pair (e.g.,fluid/viscous correlated to variability in angular velocity). In a user study,we measured quantitative data (e.g.,limb accelerations,skin conductivity,and muscle activity),for subjects (n=3,novice to expert) performing tasks on a robotic surgical simulator. Task and posture videos were recorded for each repetition and crowd-workers labeled the videos by selecting one word from each pair. The expert was assigned more positive words and also had better quantitative metrics for the majority of the chosen word pairs,showing feasibility for automated coaching.

Original languageEnglish (US)
Title of host publicationMedical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings
PublisherSpringer Verlag
Pages508-515
Number of pages8
Volume9900 LNCS
ISBN (Print)9783319467191
DOIs
StatePublished - 2016
Event1st International Workshop on Simulation and Synthesis in Medical Imaging, SASHIMI 2016 held in conjunction with 19th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2016 - Athens, Greece
Duration: Oct 21 2016Oct 21 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9900 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other1st International Workshop on Simulation and Synthesis in Medical Imaging, SASHIMI 2016 held in conjunction with 19th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2016
CountryGreece
CityAthens
Period10/21/1610/21/16

Fingerprint

Angular velocity
Expertise
Labeling
Muscle
Labels
Skin
Robotics
Simulators
Semantics
Metric
Fluids
User Studies
Viscous Fluid
Conductivity
Simulator
Choose
Motion

Keywords

  • Crowdsourced assessment
  • Semantic descriptors
  • Surgical training and evaluation

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Ershad, M., Koesters, Z., Rege, R. V., & Majewicz, A. (2016). Meaningful assessment of surgical expertise: Semantic labeling with data and crowds. In Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings (Vol. 9900 LNCS, pp. 508-515). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9900 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-46720-7_59

Meaningful assessment of surgical expertise : Semantic labeling with data and crowds. / Ershad, Marzieh; Koesters, Zachary; Rege, Robert V; Majewicz, Ann.

Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings. Vol. 9900 LNCS Springer Verlag, 2016. p. 508-515 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9900 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ershad, M, Koesters, Z, Rege, RV & Majewicz, A 2016, Meaningful assessment of surgical expertise: Semantic labeling with data and crowds. in Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings. vol. 9900 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9900 LNCS, Springer Verlag, pp. 508-515, 1st International Workshop on Simulation and Synthesis in Medical Imaging, SASHIMI 2016 held in conjunction with 19th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2016, Athens, Greece, 10/21/16. https://doi.org/10.1007/978-3-319-46720-7_59
Ershad M, Koesters Z, Rege RV, Majewicz A. Meaningful assessment of surgical expertise: Semantic labeling with data and crowds. In Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings. Vol. 9900 LNCS. Springer Verlag. 2016. p. 508-515. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-46720-7_59
Ershad, Marzieh ; Koesters, Zachary ; Rege, Robert V ; Majewicz, Ann. / Meaningful assessment of surgical expertise : Semantic labeling with data and crowds. Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings. Vol. 9900 LNCS Springer Verlag, 2016. pp. 508-515 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{948bf2adb773429d87bdecaa159b2bc0,
title = "Meaningful assessment of surgical expertise: Semantic labeling with data and crowds",
abstract = "Many surgical assessment metrics have been developed to identify and rank surgical expertise; however,some of these metrics (e.g.,economy of motion) can be difficult to understand and do not coach the user on how to modify behavior. We aim to standardize assessment language by identifying key semantic labels for expertise. We chose six pairs of contrasting adjectives and associated a metric with each pair (e.g.,fluid/viscous correlated to variability in angular velocity). In a user study,we measured quantitative data (e.g.,limb accelerations,skin conductivity,and muscle activity),for subjects (n=3,novice to expert) performing tasks on a robotic surgical simulator. Task and posture videos were recorded for each repetition and crowd-workers labeled the videos by selecting one word from each pair. The expert was assigned more positive words and also had better quantitative metrics for the majority of the chosen word pairs,showing feasibility for automated coaching.",
keywords = "Crowdsourced assessment, Semantic descriptors, Surgical training and evaluation",
author = "Marzieh Ershad and Zachary Koesters and Rege, {Robert V} and Ann Majewicz",
year = "2016",
doi = "10.1007/978-3-319-46720-7_59",
language = "English (US)",
isbn = "9783319467191",
volume = "9900 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "508--515",
booktitle = "Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings",

}

TY - GEN

T1 - Meaningful assessment of surgical expertise

T2 - Semantic labeling with data and crowds

AU - Ershad, Marzieh

AU - Koesters, Zachary

AU - Rege, Robert V

AU - Majewicz, Ann

PY - 2016

Y1 - 2016

N2 - Many surgical assessment metrics have been developed to identify and rank surgical expertise; however,some of these metrics (e.g.,economy of motion) can be difficult to understand and do not coach the user on how to modify behavior. We aim to standardize assessment language by identifying key semantic labels for expertise. We chose six pairs of contrasting adjectives and associated a metric with each pair (e.g.,fluid/viscous correlated to variability in angular velocity). In a user study,we measured quantitative data (e.g.,limb accelerations,skin conductivity,and muscle activity),for subjects (n=3,novice to expert) performing tasks on a robotic surgical simulator. Task and posture videos were recorded for each repetition and crowd-workers labeled the videos by selecting one word from each pair. The expert was assigned more positive words and also had better quantitative metrics for the majority of the chosen word pairs,showing feasibility for automated coaching.

AB - Many surgical assessment metrics have been developed to identify and rank surgical expertise; however,some of these metrics (e.g.,economy of motion) can be difficult to understand and do not coach the user on how to modify behavior. We aim to standardize assessment language by identifying key semantic labels for expertise. We chose six pairs of contrasting adjectives and associated a metric with each pair (e.g.,fluid/viscous correlated to variability in angular velocity). In a user study,we measured quantitative data (e.g.,limb accelerations,skin conductivity,and muscle activity),for subjects (n=3,novice to expert) performing tasks on a robotic surgical simulator. Task and posture videos were recorded for each repetition and crowd-workers labeled the videos by selecting one word from each pair. The expert was assigned more positive words and also had better quantitative metrics for the majority of the chosen word pairs,showing feasibility for automated coaching.

KW - Crowdsourced assessment

KW - Semantic descriptors

KW - Surgical training and evaluation

UR - http://www.scopus.com/inward/record.url?scp=84996564762&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84996564762&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-46720-7_59

DO - 10.1007/978-3-319-46720-7_59

M3 - Conference contribution

AN - SCOPUS:84996564762

SN - 9783319467191

VL - 9900 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 508

EP - 515

BT - Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings

PB - Springer Verlag

ER -