Frame-of-reference training for simulation-based intraoperative communication assessment

Aimee K. Gardner, Michael A. Russo, Ibrahim I. Jabbour, Matthew Kosemund, Daniel J. Scott

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Background The purpose of this study was to examine the impact of frame-of-reference (FOR) training on assessments of intraoperative communication skills and identify areas of need to inform curricular efforts. Methods Simulation instructors (M.D., Ph.D., Research Fellow, Simulation Technician) underwent a 2-hour FOR training session with the operating room communication instrument. They then independently rated communication skills of 19 PGY1s who participated in a team-based simulation. Residents completed self-assessments via video review of the scenario. Intraclass correlation coefficients were used to examine inter-rater reliability. Relationships between trained raters and resident scores were assessed with Pearson correlation coefficients and paired sample t tests. Results Inter-reliability after FOR training was .91. The correlation between trained rater scores and resident evaluations was nonsignificant. Residents significantly underestimated their intraoperative communication skills (P < .05). Use of names, closed loop communication, and sharing information with team members demonstrated consistently low ratings among all residents. Conclusions These findings reveal that a number of individuals can be trained to reliably rate resident intraoperative communication performance and that residents tend to under-rate their communication skills.

Original languageEnglish (US)
Pages (from-to)548-551.e2
JournalAmerican Journal of Surgery
Volume212
Issue number3
DOIs
StatePublished - Sep 1 2016

Fingerprint

Communication
Teach-Back Communication
Information Dissemination
Operating Rooms
Reproducibility of Results
Names
Simulation Training
Research

Keywords

  • Frame of reference training
  • Intraoperative communication
  • Residents
  • Simulation
  • Team training

ASJC Scopus subject areas

  • Surgery

Cite this

Frame-of-reference training for simulation-based intraoperative communication assessment. / Gardner, Aimee K.; Russo, Michael A.; Jabbour, Ibrahim I.; Kosemund, Matthew; Scott, Daniel J.

In: American Journal of Surgery, Vol. 212, No. 3, 01.09.2016, p. 548-551.e2.

Research output: Contribution to journalArticle

Gardner, Aimee K. ; Russo, Michael A. ; Jabbour, Ibrahim I. ; Kosemund, Matthew ; Scott, Daniel J. / Frame-of-reference training for simulation-based intraoperative communication assessment. In: American Journal of Surgery. 2016 ; Vol. 212, No. 3. pp. 548-551.e2.
@article{26acd792cd4d4897a4a25d10c1157720,
title = "Frame-of-reference training for simulation-based intraoperative communication assessment",
abstract = "Background The purpose of this study was to examine the impact of frame-of-reference (FOR) training on assessments of intraoperative communication skills and identify areas of need to inform curricular efforts. Methods Simulation instructors (M.D., Ph.D., Research Fellow, Simulation Technician) underwent a 2-hour FOR training session with the operating room communication instrument. They then independently rated communication skills of 19 PGY1s who participated in a team-based simulation. Residents completed self-assessments via video review of the scenario. Intraclass correlation coefficients were used to examine inter-rater reliability. Relationships between trained raters and resident scores were assessed with Pearson correlation coefficients and paired sample t tests. Results Inter-reliability after FOR training was .91. The correlation between trained rater scores and resident evaluations was nonsignificant. Residents significantly underestimated their intraoperative communication skills (P < .05). Use of names, closed loop communication, and sharing information with team members demonstrated consistently low ratings among all residents. Conclusions These findings reveal that a number of individuals can be trained to reliably rate resident intraoperative communication performance and that residents tend to under-rate their communication skills.",
keywords = "Frame of reference training, Intraoperative communication, Residents, Simulation, Team training",
author = "Gardner, {Aimee K.} and Russo, {Michael A.} and Jabbour, {Ibrahim I.} and Matthew Kosemund and Scott, {Daniel J.}",
year = "2016",
month = "9",
day = "1",
doi = "10.1016/j.amjsurg.2016.02.009",
language = "English (US)",
volume = "212",
pages = "548--551.e2",
journal = "American Journal of Surgery",
issn = "0002-9610",
publisher = "Elsevier Inc.",
number = "3",

}

TY - JOUR

T1 - Frame-of-reference training for simulation-based intraoperative communication assessment

AU - Gardner, Aimee K.

AU - Russo, Michael A.

AU - Jabbour, Ibrahim I.

AU - Kosemund, Matthew

AU - Scott, Daniel J.

PY - 2016/9/1

Y1 - 2016/9/1

N2 - Background The purpose of this study was to examine the impact of frame-of-reference (FOR) training on assessments of intraoperative communication skills and identify areas of need to inform curricular efforts. Methods Simulation instructors (M.D., Ph.D., Research Fellow, Simulation Technician) underwent a 2-hour FOR training session with the operating room communication instrument. They then independently rated communication skills of 19 PGY1s who participated in a team-based simulation. Residents completed self-assessments via video review of the scenario. Intraclass correlation coefficients were used to examine inter-rater reliability. Relationships between trained raters and resident scores were assessed with Pearson correlation coefficients and paired sample t tests. Results Inter-reliability after FOR training was .91. The correlation between trained rater scores and resident evaluations was nonsignificant. Residents significantly underestimated their intraoperative communication skills (P < .05). Use of names, closed loop communication, and sharing information with team members demonstrated consistently low ratings among all residents. Conclusions These findings reveal that a number of individuals can be trained to reliably rate resident intraoperative communication performance and that residents tend to under-rate their communication skills.

AB - Background The purpose of this study was to examine the impact of frame-of-reference (FOR) training on assessments of intraoperative communication skills and identify areas of need to inform curricular efforts. Methods Simulation instructors (M.D., Ph.D., Research Fellow, Simulation Technician) underwent a 2-hour FOR training session with the operating room communication instrument. They then independently rated communication skills of 19 PGY1s who participated in a team-based simulation. Residents completed self-assessments via video review of the scenario. Intraclass correlation coefficients were used to examine inter-rater reliability. Relationships between trained raters and resident scores were assessed with Pearson correlation coefficients and paired sample t tests. Results Inter-reliability after FOR training was .91. The correlation between trained rater scores and resident evaluations was nonsignificant. Residents significantly underestimated their intraoperative communication skills (P < .05). Use of names, closed loop communication, and sharing information with team members demonstrated consistently low ratings among all residents. Conclusions These findings reveal that a number of individuals can be trained to reliably rate resident intraoperative communication performance and that residents tend to under-rate their communication skills.

KW - Frame of reference training

KW - Intraoperative communication

KW - Residents

KW - Simulation

KW - Team training

UR - http://www.scopus.com/inward/record.url?scp=84977668197&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84977668197&partnerID=8YFLogxK

U2 - 10.1016/j.amjsurg.2016.02.009

DO - 10.1016/j.amjsurg.2016.02.009

M3 - Article

C2 - 27372147

AN - SCOPUS:84977668197

VL - 212

SP - 548-551.e2

JO - American Journal of Surgery

JF - American Journal of Surgery

SN - 0002-9610

IS - 3

ER -