TY - JOUR
T1 - Content Evidence for Validity of Time-to-Task Initiation
T2 - A Novel Measure of Learner Competence
AU - Nichols, Blake E.
AU - McMichael, Ali B.V.
AU - Ambardekar, Aditee P.
N1 - Publisher Copyright:
Copyright © 2020 Society for Simulation in Healthcare.
PY - 2021/12/1
Y1 - 2021/12/1
N2 - INTRODUCTION: Educators require validated tools to assess learner competency in simulation-based mastery learning. We previously created a simulation to incorporate crisis resource management skills after a needs assessment of our pediatric residency program. We present the development of and content evidence for validity of a task list with time-to-task initiation designed to aid in rapid cycle deliberate practice (RCDP) debriefing and assessment of pediatrics resident learners. METHODS: Five board-certified pediatricians developed the initial task list with 30 tasks. We used the Delphi technique to seek content evidence for validity of the initial task list using 17 board-certified pediatricians at 7 institutions across the United States. After finalizing the task list, we video recorded 3 pediatric experts performing the tasks in a simulation. We then used the Delphi technique to establish and to attain agreement on time-to-task initiation. We calculated Cronbach α coefficient to measure internal consistency of the expert responses. After finalizing the task list, we divided it into 3 stages with 5 separate cycles per stage to direct the educator in performance of RCDP debriefing. RESULTS: The group reached 80% agreement after 2 Delphi rounds with a Cronbach α coefficient of 0.95. The resultant list included 25 tasks. The group subsequently achieved 80% agreement on the time-to-task initiation in 2 Delphi rounds. CONCLUSIONS: We present content evidence for validity of a task list with associated time-to-task initiation for a simulation scenario that incorporates crisis resource management skills and is designed to aid educators in RCDP debriefing. This task list may decrease intereducator inconsistencies in delivery of RCDP for a common pediatric resuscitation scenario.
AB - INTRODUCTION: Educators require validated tools to assess learner competency in simulation-based mastery learning. We previously created a simulation to incorporate crisis resource management skills after a needs assessment of our pediatric residency program. We present the development of and content evidence for validity of a task list with time-to-task initiation designed to aid in rapid cycle deliberate practice (RCDP) debriefing and assessment of pediatrics resident learners. METHODS: Five board-certified pediatricians developed the initial task list with 30 tasks. We used the Delphi technique to seek content evidence for validity of the initial task list using 17 board-certified pediatricians at 7 institutions across the United States. After finalizing the task list, we video recorded 3 pediatric experts performing the tasks in a simulation. We then used the Delphi technique to establish and to attain agreement on time-to-task initiation. We calculated Cronbach α coefficient to measure internal consistency of the expert responses. After finalizing the task list, we divided it into 3 stages with 5 separate cycles per stage to direct the educator in performance of RCDP debriefing. RESULTS: The group reached 80% agreement after 2 Delphi rounds with a Cronbach α coefficient of 0.95. The resultant list included 25 tasks. The group subsequently achieved 80% agreement on the time-to-task initiation in 2 Delphi rounds. CONCLUSIONS: We present content evidence for validity of a task list with associated time-to-task initiation for a simulation scenario that incorporates crisis resource management skills and is designed to aid educators in RCDP debriefing. This task list may decrease intereducator inconsistencies in delivery of RCDP for a common pediatric resuscitation scenario.
UR - http://www.scopus.com/inward/record.url?scp=85122546788&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85122546788&partnerID=8YFLogxK
U2 - 10.1097/SIH.0000000000000536
DO - 10.1097/SIH.0000000000000536
M3 - Article
C2 - 33370084
AN - SCOPUS:85122546788
VL - 16
SP - e194-e199
JO - Simulation in Healthcare
JF - Simulation in Healthcare
SN - 1559-2332
IS - 6
ER -