Abstract
BACKGROUND: Experts identified camera navigation and cannulation as important skills that are not assessed by the Fundamentals of Laparoscopic Surgery (FLS) hands-on examination. The purpose of this study was to create metrics for and evaluate the validity for two new tasks: camera navigation (N) and cannulation (C), and to explore the potential value of adding these tasks to the FLS program.
METHODS: Participants were assessed by two raters during performance of N and C in addition to the five standard FLS tasks. They also completed a questionnaire regarding the educational value of the new tasks. Validity evidence was assessed by comparing performance between Novice (PGY 1 and 2) and Experienced (PGY 3 and higher) participants, and by correlating new task scores with standard FLS scores. The ability to predict level of training using scores was evaluated by regression analysis.
RESULTS: Sixty subjects participated from five North American centers. Inter-rater reliabilities for both tasks were 0.99. Novice and Experienced participants scored 74 ± 17.8 versus 85 ± 8.3 (p < 0.01) and 21 ± 17.3 versus 39 ± 20.1 (p < 0.01) on N and C tasks, respectively. Correlations with total FLS scores for N and C were 0.39 and 0.53, respectively. Prediction of training level using the combination of all seven tasks was 52.6 % (R (2) = 0.526, p < 0.01), adding an additional 2.2 % to the five FLS tasks. Of 55 participants with laparoscopic experience, 51 % reported N to be similar in difficulty to reality. Of 28 participants who perform intraoperative cholangiograms, 43 % found C to be more difficult than reality. Most (70 %) participants thought the new tasks added value to FLS.
CONCLUSIONS: This study provides preliminary validity evidence for the metrics of these new tasks. The value of adding these tasks to the FLS manual skills assessment is marginal in terms of predicting level of training.
| Original language | English (US) |
|---|---|
| Pages (from-to) | 552-557 |
| Number of pages | 6 |
| Journal | Surgical Endoscopy and Other Interventional Techniques |
| Volume | 29 |
| Issue number | 3 |
| DOIs | |
| State | Published - Mar 1 2015 |
Fingerprint
ASJC Scopus subject areas
- Surgery
Cite this
Camera navigation and cannulation : validity evidence for new educational tasks to complement the Fundamentals of Laparoscopic Surgery program. / Watanabe, Yusuke; Matt Ritter, E.; Schwaitzberg, Steven D.; Korndorffer, James R.; Scott, Daniel J.; Okrainec, Allan; Bilgic, Elif; Kaneva, Pepa A.; O’Donnell, Mary T.; Feldman, Liane S.; Fried, Gerald M.; Vassiliou, Melina C.
In: Surgical Endoscopy and Other Interventional Techniques, Vol. 29, No. 3, 01.03.2015, p. 552-557.Research output: Contribution to journal › Article
}
TY - JOUR
T1 - Camera navigation and cannulation
T2 - validity evidence for new educational tasks to complement the Fundamentals of Laparoscopic Surgery program
AU - Watanabe, Yusuke
AU - Matt Ritter, E.
AU - Schwaitzberg, Steven D.
AU - Korndorffer, James R.
AU - Scott, Daniel J.
AU - Okrainec, Allan
AU - Bilgic, Elif
AU - Kaneva, Pepa A.
AU - O’Donnell, Mary T.
AU - Feldman, Liane S.
AU - Fried, Gerald M.
AU - Vassiliou, Melina C.
PY - 2015/3/1
Y1 - 2015/3/1
N2 - BACKGROUND: Experts identified camera navigation and cannulation as important skills that are not assessed by the Fundamentals of Laparoscopic Surgery (FLS) hands-on examination. The purpose of this study was to create metrics for and evaluate the validity for two new tasks: camera navigation (N) and cannulation (C), and to explore the potential value of adding these tasks to the FLS program.METHODS: Participants were assessed by two raters during performance of N and C in addition to the five standard FLS tasks. They also completed a questionnaire regarding the educational value of the new tasks. Validity evidence was assessed by comparing performance between Novice (PGY 1 and 2) and Experienced (PGY 3 and higher) participants, and by correlating new task scores with standard FLS scores. The ability to predict level of training using scores was evaluated by regression analysis.RESULTS: Sixty subjects participated from five North American centers. Inter-rater reliabilities for both tasks were 0.99. Novice and Experienced participants scored 74 ± 17.8 versus 85 ± 8.3 (p < 0.01) and 21 ± 17.3 versus 39 ± 20.1 (p < 0.01) on N and C tasks, respectively. Correlations with total FLS scores for N and C were 0.39 and 0.53, respectively. Prediction of training level using the combination of all seven tasks was 52.6 % (R (2) = 0.526, p < 0.01), adding an additional 2.2 % to the five FLS tasks. Of 55 participants with laparoscopic experience, 51 % reported N to be similar in difficulty to reality. Of 28 participants who perform intraoperative cholangiograms, 43 % found C to be more difficult than reality. Most (70 %) participants thought the new tasks added value to FLS.CONCLUSIONS: This study provides preliminary validity evidence for the metrics of these new tasks. The value of adding these tasks to the FLS manual skills assessment is marginal in terms of predicting level of training.
AB - BACKGROUND: Experts identified camera navigation and cannulation as important skills that are not assessed by the Fundamentals of Laparoscopic Surgery (FLS) hands-on examination. The purpose of this study was to create metrics for and evaluate the validity for two new tasks: camera navigation (N) and cannulation (C), and to explore the potential value of adding these tasks to the FLS program.METHODS: Participants were assessed by two raters during performance of N and C in addition to the five standard FLS tasks. They also completed a questionnaire regarding the educational value of the new tasks. Validity evidence was assessed by comparing performance between Novice (PGY 1 and 2) and Experienced (PGY 3 and higher) participants, and by correlating new task scores with standard FLS scores. The ability to predict level of training using scores was evaluated by regression analysis.RESULTS: Sixty subjects participated from five North American centers. Inter-rater reliabilities for both tasks were 0.99. Novice and Experienced participants scored 74 ± 17.8 versus 85 ± 8.3 (p < 0.01) and 21 ± 17.3 versus 39 ± 20.1 (p < 0.01) on N and C tasks, respectively. Correlations with total FLS scores for N and C were 0.39 and 0.53, respectively. Prediction of training level using the combination of all seven tasks was 52.6 % (R (2) = 0.526, p < 0.01), adding an additional 2.2 % to the five FLS tasks. Of 55 participants with laparoscopic experience, 51 % reported N to be similar in difficulty to reality. Of 28 participants who perform intraoperative cholangiograms, 43 % found C to be more difficult than reality. Most (70 %) participants thought the new tasks added value to FLS.CONCLUSIONS: This study provides preliminary validity evidence for the metrics of these new tasks. The value of adding these tasks to the FLS manual skills assessment is marginal in terms of predicting level of training.
UR - http://www.scopus.com/inward/record.url?scp=84996538525&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84996538525&partnerID=8YFLogxK
U2 - 10.1007/s00464-014-3721-5
DO - 10.1007/s00464-014-3721-5
M3 - Article
C2 - 25034381
AN - SCOPUS:84939889243
VL - 29
SP - 552
EP - 557
JO - Surgical Endoscopy and Other Interventional Techniques
JF - Surgical Endoscopy and Other Interventional Techniques
SN - 0930-2794
IS - 3
ER -