Are General Surgery Residents Accurate Assessors of Their Own Flexible Endoscopy Skills?

Parth Vyasa, Ross E. Willis, Brian J. Dunkin, Aimee K. Gardner

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Background: Surgeons in training must be able to accurately gauge their own ability and performance to better understand where additional practice is needed and can help inform self-directed learning endeavors. This study had the following 3 goals: (1) to examine the accuracy of residents' assessments of their endoscopic skills, (2) to investigate if accuracy improves over time and practice, and (3) to compare the efficacy of 3 interventions-practice only (PO), self-observation (SO), or expert observation (EO)-on self-assessment accuracy. Methods: Overall, 30 first-year general surgery residents completed a pretest on a colonoscopy simulator, which measured time to completion, time to reach the cecum, efficiency of screening, percentage of mucosal surface area examined, time the patient was in pain, and time with a clear view. Residents assigned to the SO and EO conditions reviewed a video of their own performances (SO) or an expert's performance (EO). Residents in all conditions engaged in practice trials using an abstract endoscopy training exercise. Residents then completed a posttest. Self-assessment was examined by calculating discrepancy scores by subtracting actual measurements from participant judgments. Results: Results indicated that performance for participants in the PO group significantly improved from pretest to posttest for 2 of the 6 metrics and participants in the SO and EO groups improved for 4 metrics. In terms of self-assessment discrepancy scores, only the EO group significantly improved for 2 of the 6 metrics (overall time and screening efficiency). Discussion: Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance. Participants assigned to PO exhibited decreased ability to accurately judge their own performance. Those in the EO group became significantly better at assessing their overall time and overall efficiency. Summary: Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance.

Original languageEnglish (US)
JournalJournal of Surgical Education
DOIs
StateAccepted/In press - 2016

Fingerprint

surgery
Endoscopy
Observation
resident
expert
trainee
performance
self-assessment
Aptitude
video
Task Performance and Analysis
Efficiency
efficiency
Group
Cecum
ability
Colonoscopy
time
pain
Learning

Keywords

  • Education
  • Endoscopy
  • Practice-Based Learning and Improvement
  • Residents
  • Self-assessment
  • Video review

ASJC Scopus subject areas

  • Surgery
  • Education

Cite this

Are General Surgery Residents Accurate Assessors of Their Own Flexible Endoscopy Skills? / Vyasa, Parth; Willis, Ross E.; Dunkin, Brian J.; Gardner, Aimee K.

In: Journal of Surgical Education, 2016.

Research output: Contribution to journalArticle

@article{4d4bfca45c6542689e5f4ca1aeaac20f,
title = "Are General Surgery Residents Accurate Assessors of Their Own Flexible Endoscopy Skills?",
abstract = "Background: Surgeons in training must be able to accurately gauge their own ability and performance to better understand where additional practice is needed and can help inform self-directed learning endeavors. This study had the following 3 goals: (1) to examine the accuracy of residents' assessments of their endoscopic skills, (2) to investigate if accuracy improves over time and practice, and (3) to compare the efficacy of 3 interventions-practice only (PO), self-observation (SO), or expert observation (EO)-on self-assessment accuracy. Methods: Overall, 30 first-year general surgery residents completed a pretest on a colonoscopy simulator, which measured time to completion, time to reach the cecum, efficiency of screening, percentage of mucosal surface area examined, time the patient was in pain, and time with a clear view. Residents assigned to the SO and EO conditions reviewed a video of their own performances (SO) or an expert's performance (EO). Residents in all conditions engaged in practice trials using an abstract endoscopy training exercise. Residents then completed a posttest. Self-assessment was examined by calculating discrepancy scores by subtracting actual measurements from participant judgments. Results: Results indicated that performance for participants in the PO group significantly improved from pretest to posttest for 2 of the 6 metrics and participants in the SO and EO groups improved for 4 metrics. In terms of self-assessment discrepancy scores, only the EO group significantly improved for 2 of the 6 metrics (overall time and screening efficiency). Discussion: Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance. Participants assigned to PO exhibited decreased ability to accurately judge their own performance. Those in the EO group became significantly better at assessing their overall time and overall efficiency. Summary: Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance.",
keywords = "Education, Endoscopy, Practice-Based Learning and Improvement, Residents, Self-assessment, Video review",
author = "Parth Vyasa and Willis, {Ross E.} and Dunkin, {Brian J.} and Gardner, {Aimee K.}",
year = "2016",
doi = "10.1016/j.jsurg.2016.06.018",
language = "English (US)",
journal = "Journal of Surgical Education",
issn = "1931-7204",
publisher = "Elsevier Inc.",

}

TY - JOUR

T1 - Are General Surgery Residents Accurate Assessors of Their Own Flexible Endoscopy Skills?

AU - Vyasa, Parth

AU - Willis, Ross E.

AU - Dunkin, Brian J.

AU - Gardner, Aimee K.

PY - 2016

Y1 - 2016

N2 - Background: Surgeons in training must be able to accurately gauge their own ability and performance to better understand where additional practice is needed and can help inform self-directed learning endeavors. This study had the following 3 goals: (1) to examine the accuracy of residents' assessments of their endoscopic skills, (2) to investigate if accuracy improves over time and practice, and (3) to compare the efficacy of 3 interventions-practice only (PO), self-observation (SO), or expert observation (EO)-on self-assessment accuracy. Methods: Overall, 30 first-year general surgery residents completed a pretest on a colonoscopy simulator, which measured time to completion, time to reach the cecum, efficiency of screening, percentage of mucosal surface area examined, time the patient was in pain, and time with a clear view. Residents assigned to the SO and EO conditions reviewed a video of their own performances (SO) or an expert's performance (EO). Residents in all conditions engaged in practice trials using an abstract endoscopy training exercise. Residents then completed a posttest. Self-assessment was examined by calculating discrepancy scores by subtracting actual measurements from participant judgments. Results: Results indicated that performance for participants in the PO group significantly improved from pretest to posttest for 2 of the 6 metrics and participants in the SO and EO groups improved for 4 metrics. In terms of self-assessment discrepancy scores, only the EO group significantly improved for 2 of the 6 metrics (overall time and screening efficiency). Discussion: Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance. Participants assigned to PO exhibited decreased ability to accurately judge their own performance. Those in the EO group became significantly better at assessing their overall time and overall efficiency. Summary: Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance.

AB - Background: Surgeons in training must be able to accurately gauge their own ability and performance to better understand where additional practice is needed and can help inform self-directed learning endeavors. This study had the following 3 goals: (1) to examine the accuracy of residents' assessments of their endoscopic skills, (2) to investigate if accuracy improves over time and practice, and (3) to compare the efficacy of 3 interventions-practice only (PO), self-observation (SO), or expert observation (EO)-on self-assessment accuracy. Methods: Overall, 30 first-year general surgery residents completed a pretest on a colonoscopy simulator, which measured time to completion, time to reach the cecum, efficiency of screening, percentage of mucosal surface area examined, time the patient was in pain, and time with a clear view. Residents assigned to the SO and EO conditions reviewed a video of their own performances (SO) or an expert's performance (EO). Residents in all conditions engaged in practice trials using an abstract endoscopy training exercise. Residents then completed a posttest. Self-assessment was examined by calculating discrepancy scores by subtracting actual measurements from participant judgments. Results: Results indicated that performance for participants in the PO group significantly improved from pretest to posttest for 2 of the 6 metrics and participants in the SO and EO groups improved for 4 metrics. In terms of self-assessment discrepancy scores, only the EO group significantly improved for 2 of the 6 metrics (overall time and screening efficiency). Discussion: Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance. Participants assigned to PO exhibited decreased ability to accurately judge their own performance. Those in the EO group became significantly better at assessing their overall time and overall efficiency. Summary: Novice trainees are inaccurate self-assessors of their endoscopic skills before training. Allowing trainees to watch videos of themselves or an expert performing an endoscopic task enhances performance.

KW - Education

KW - Endoscopy

KW - Practice-Based Learning and Improvement

KW - Residents

KW - Self-assessment

KW - Video review

UR - http://www.scopus.com/inward/record.url?scp=84981725658&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84981725658&partnerID=8YFLogxK

U2 - 10.1016/j.jsurg.2016.06.018

DO - 10.1016/j.jsurg.2016.06.018

M3 - Article

C2 - 27522346

AN - SCOPUS:84981725658

JO - Journal of Surgical Education

JF - Journal of Surgical Education

SN - 1931-7204

ER -