Examining the Feasibility and Predictive Validity of the SAGAT Tool to Assess Situation Awareness Among Medical Trainees

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

INTRODUCTION: Situational awareness (SA) describes a teamʼs ability to perceive environmental elements, comprehend their meaning, and anticipate future events. Although SA is consistently described as a critical competency among surgical teams, there is a dearth of research identifying efficacious methods to assess and develop SA in such settings. The aim of this study was to investigate the feasibility of implementing an objective tool that has been used to measure SA in other intense and dynamic environments —the Situation Awareness Global Assessment Technique (SAGAT)—and to examine its ability to predict surgical trainee team performance. METHODS: Ten team-training sessions were conducted involving 2 standardized high-fidelity trauma simulation scenarios. Teams consisted of 4 or 5 participants, and roles were randomly assigned. Team situational awareness was assessed using the SAGAT method, which involves intermittent freezes to probe trainee awareness of the situation. Team performance was assessed using the Mayo High-Performance Teamwork Scale. Hierarchical regression was used to examine SA-performance relationships for each scenario. RESULTS: Forty-three third-year medical students participated in the training sessions. Team SA ranged from 45% to 79% and 46% to 97% for the first and second scenarios, respectively. Additionally, team SA significantly predicted team performance for both the first scenario (F(1, 42)=19.57; P<0.001; R=0.30) and second scenario (F(1,42)=26.18, P<0.001; R=0.38). CONCLUSIONS: The SAGAT is a valid, reliable tool for assessing surgical trainee SA. Information provided by the SAGAT can help diagnose team performance problems, inform debriefing discussion points, and inform curriculum development endeavors.

Original languageEnglish (US)
JournalSimulation in Healthcare
DOIs
StateAccepted/In press - Aug 8 2016

Fingerprint

Situation Awareness
Situational Awareness
trainee
Curricula
Students
scenario
Scenarios
performance
Aptitude
Team Work
ability
curriculum development
teamwork
Dynamic Environment
Fidelity
trauma
medical student
Probe
Medical Students
High Performance

ASJC Scopus subject areas

  • Medicine (miscellaneous)
  • Epidemiology
  • Education
  • Modeling and Simulation

Cite this

@article{00ab54e80c97412b8e3cff6eb008b531,
title = "Examining the Feasibility and Predictive Validity of the SAGAT Tool to Assess Situation Awareness Among Medical Trainees",
abstract = "INTRODUCTION: Situational awareness (SA) describes a teamʼs ability to perceive environmental elements, comprehend their meaning, and anticipate future events. Although SA is consistently described as a critical competency among surgical teams, there is a dearth of research identifying efficacious methods to assess and develop SA in such settings. The aim of this study was to investigate the feasibility of implementing an objective tool that has been used to measure SA in other intense and dynamic environments —the Situation Awareness Global Assessment Technique (SAGAT)—and to examine its ability to predict surgical trainee team performance. METHODS: Ten team-training sessions were conducted involving 2 standardized high-fidelity trauma simulation scenarios. Teams consisted of 4 or 5 participants, and roles were randomly assigned. Team situational awareness was assessed using the SAGAT method, which involves intermittent freezes to probe trainee awareness of the situation. Team performance was assessed using the Mayo High-Performance Teamwork Scale. Hierarchical regression was used to examine SA-performance relationships for each scenario. RESULTS: Forty-three third-year medical students participated in the training sessions. Team SA ranged from 45{\%} to 79{\%} and 46{\%} to 97{\%} for the first and second scenarios, respectively. Additionally, team SA significantly predicted team performance for both the first scenario (F(1, 42)=19.57; P<0.001; R=0.30) and second scenario (F(1,42)=26.18, P<0.001; R=0.38). CONCLUSIONS: The SAGAT is a valid, reliable tool for assessing surgical trainee SA. Information provided by the SAGAT can help diagnose team performance problems, inform debriefing discussion points, and inform curriculum development endeavors.",
author = "Gardner, {Aimee K.} and Matthew Kosemund and Joseph Martinez",
year = "2016",
month = "8",
day = "8",
doi = "10.1097/SIH.0000000000000181",
language = "English (US)",
journal = "Simulation in Healthcare",
issn = "1559-2332",
publisher = "Lippincott Williams and Wilkins",

}

TY - JOUR

T1 - Examining the Feasibility and Predictive Validity of the SAGAT Tool to Assess Situation Awareness Among Medical Trainees

AU - Gardner, Aimee K.

AU - Kosemund, Matthew

AU - Martinez, Joseph

PY - 2016/8/8

Y1 - 2016/8/8

N2 - INTRODUCTION: Situational awareness (SA) describes a teamʼs ability to perceive environmental elements, comprehend their meaning, and anticipate future events. Although SA is consistently described as a critical competency among surgical teams, there is a dearth of research identifying efficacious methods to assess and develop SA in such settings. The aim of this study was to investigate the feasibility of implementing an objective tool that has been used to measure SA in other intense and dynamic environments —the Situation Awareness Global Assessment Technique (SAGAT)—and to examine its ability to predict surgical trainee team performance. METHODS: Ten team-training sessions were conducted involving 2 standardized high-fidelity trauma simulation scenarios. Teams consisted of 4 or 5 participants, and roles were randomly assigned. Team situational awareness was assessed using the SAGAT method, which involves intermittent freezes to probe trainee awareness of the situation. Team performance was assessed using the Mayo High-Performance Teamwork Scale. Hierarchical regression was used to examine SA-performance relationships for each scenario. RESULTS: Forty-three third-year medical students participated in the training sessions. Team SA ranged from 45% to 79% and 46% to 97% for the first and second scenarios, respectively. Additionally, team SA significantly predicted team performance for both the first scenario (F(1, 42)=19.57; P<0.001; R=0.30) and second scenario (F(1,42)=26.18, P<0.001; R=0.38). CONCLUSIONS: The SAGAT is a valid, reliable tool for assessing surgical trainee SA. Information provided by the SAGAT can help diagnose team performance problems, inform debriefing discussion points, and inform curriculum development endeavors.

AB - INTRODUCTION: Situational awareness (SA) describes a teamʼs ability to perceive environmental elements, comprehend their meaning, and anticipate future events. Although SA is consistently described as a critical competency among surgical teams, there is a dearth of research identifying efficacious methods to assess and develop SA in such settings. The aim of this study was to investigate the feasibility of implementing an objective tool that has been used to measure SA in other intense and dynamic environments —the Situation Awareness Global Assessment Technique (SAGAT)—and to examine its ability to predict surgical trainee team performance. METHODS: Ten team-training sessions were conducted involving 2 standardized high-fidelity trauma simulation scenarios. Teams consisted of 4 or 5 participants, and roles were randomly assigned. Team situational awareness was assessed using the SAGAT method, which involves intermittent freezes to probe trainee awareness of the situation. Team performance was assessed using the Mayo High-Performance Teamwork Scale. Hierarchical regression was used to examine SA-performance relationships for each scenario. RESULTS: Forty-three third-year medical students participated in the training sessions. Team SA ranged from 45% to 79% and 46% to 97% for the first and second scenarios, respectively. Additionally, team SA significantly predicted team performance for both the first scenario (F(1, 42)=19.57; P<0.001; R=0.30) and second scenario (F(1,42)=26.18, P<0.001; R=0.38). CONCLUSIONS: The SAGAT is a valid, reliable tool for assessing surgical trainee SA. Information provided by the SAGAT can help diagnose team performance problems, inform debriefing discussion points, and inform curriculum development endeavors.

UR - http://www.scopus.com/inward/record.url?scp=84981294511&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84981294511&partnerID=8YFLogxK

U2 - 10.1097/SIH.0000000000000181

DO - 10.1097/SIH.0000000000000181

M3 - Article

C2 - 27504889

AN - SCOPUS:84981294511

JO - Simulation in Healthcare

JF - Simulation in Healthcare

SN - 1559-2332

ER -