Camera navigation and cannulation: validity evidence for new educational tasks to complement the Fundamentals of Laparoscopic Surgery program

Yusuke Watanabe, E. Matt Ritter, Steven D. Schwaitzberg, James R. Korndorffer, Daniel J. Scott, Allan Okrainec, Elif Bilgic, Pepa A. Kaneva, Mary T. O’Donnell, Liane S. Feldman, Gerald M. Fried, Melina C. Vassiliou

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

BACKGROUND: Experts identified camera navigation and cannulation as important skills that are not assessed by the Fundamentals of Laparoscopic Surgery (FLS) hands-on examination. The purpose of this study was to create metrics for and evaluate the validity for two new tasks: camera navigation (N) and cannulation (C), and to explore the potential value of adding these tasks to the FLS program.

METHODS: Participants were assessed by two raters during performance of N and C in addition to the five standard FLS tasks. They also completed a questionnaire regarding the educational value of the new tasks. Validity evidence was assessed by comparing performance between Novice (PGY 1 and 2) and Experienced (PGY 3 and higher) participants, and by correlating new task scores with standard FLS scores. The ability to predict level of training using scores was evaluated by regression analysis.

RESULTS: Sixty subjects participated from five North American centers. Inter-rater reliabilities for both tasks were 0.99. Novice and Experienced participants scored 74 ± 17.8 versus 85 ± 8.3 (p < 0.01) and 21 ± 17.3 versus 39 ± 20.1 (p < 0.01) on N and C tasks, respectively. Correlations with total FLS scores for N and C were 0.39 and 0.53, respectively. Prediction of training level using the combination of all seven tasks was 52.6 % (R (2) = 0.526, p < 0.01), adding an additional 2.2 % to the five FLS tasks. Of 55 participants with laparoscopic experience, 51 % reported N to be similar in difficulty to reality. Of 28 participants who perform intraoperative cholangiograms, 43 % found C to be more difficult than reality. Most (70 %) participants thought the new tasks added value to FLS.

CONCLUSIONS: This study provides preliminary validity evidence for the metrics of these new tasks. The value of adding these tasks to the FLS manual skills assessment is marginal in terms of predicting level of training.

Original languageEnglish (US)
Pages (from-to)552-557
Number of pages6
JournalSurgical Endoscopy and Other Interventional Techniques
Volume29
Issue number3
DOIs
StatePublished - Mar 1 2015

Fingerprint

Catheterization
Laparoscopy
Regression Analysis

ASJC Scopus subject areas

  • Surgery

Cite this

Camera navigation and cannulation : validity evidence for new educational tasks to complement the Fundamentals of Laparoscopic Surgery program. / Watanabe, Yusuke; Matt Ritter, E.; Schwaitzberg, Steven D.; Korndorffer, James R.; Scott, Daniel J.; Okrainec, Allan; Bilgic, Elif; Kaneva, Pepa A.; O’Donnell, Mary T.; Feldman, Liane S.; Fried, Gerald M.; Vassiliou, Melina C.

In: Surgical Endoscopy and Other Interventional Techniques, Vol. 29, No. 3, 01.03.2015, p. 552-557.

Research output: Contribution to journalArticle

Watanabe, Y, Matt Ritter, E, Schwaitzberg, SD, Korndorffer, JR, Scott, DJ, Okrainec, A, Bilgic, E, Kaneva, PA, O’Donnell, MT, Feldman, LS, Fried, GM & Vassiliou, MC 2015, 'Camera navigation and cannulation: validity evidence for new educational tasks to complement the Fundamentals of Laparoscopic Surgery program', Surgical Endoscopy and Other Interventional Techniques, vol. 29, no. 3, pp. 552-557. https://doi.org/10.1007/s00464-014-3721-5
Watanabe, Yusuke ; Matt Ritter, E. ; Schwaitzberg, Steven D. ; Korndorffer, James R. ; Scott, Daniel J. ; Okrainec, Allan ; Bilgic, Elif ; Kaneva, Pepa A. ; O’Donnell, Mary T. ; Feldman, Liane S. ; Fried, Gerald M. ; Vassiliou, Melina C. / Camera navigation and cannulation : validity evidence for new educational tasks to complement the Fundamentals of Laparoscopic Surgery program. In: Surgical Endoscopy and Other Interventional Techniques. 2015 ; Vol. 29, No. 3. pp. 552-557.
@article{dbed6aa74f74409fbfe1a5d868086987,
title = "Camera navigation and cannulation: validity evidence for new educational tasks to complement the Fundamentals of Laparoscopic Surgery program",
abstract = "BACKGROUND: Experts identified camera navigation and cannulation as important skills that are not assessed by the Fundamentals of Laparoscopic Surgery (FLS) hands-on examination. The purpose of this study was to create metrics for and evaluate the validity for two new tasks: camera navigation (N) and cannulation (C), and to explore the potential value of adding these tasks to the FLS program.METHODS: Participants were assessed by two raters during performance of N and C in addition to the five standard FLS tasks. They also completed a questionnaire regarding the educational value of the new tasks. Validity evidence was assessed by comparing performance between Novice (PGY 1 and 2) and Experienced (PGY 3 and higher) participants, and by correlating new task scores with standard FLS scores. The ability to predict level of training using scores was evaluated by regression analysis.RESULTS: Sixty subjects participated from five North American centers. Inter-rater reliabilities for both tasks were 0.99. Novice and Experienced participants scored 74 ± 17.8 versus 85 ± 8.3 (p < 0.01) and 21 ± 17.3 versus 39 ± 20.1 (p < 0.01) on N and C tasks, respectively. Correlations with total FLS scores for N and C were 0.39 and 0.53, respectively. Prediction of training level using the combination of all seven tasks was 52.6 {\%} (R (2) = 0.526, p < 0.01), adding an additional 2.2 {\%} to the five FLS tasks. Of 55 participants with laparoscopic experience, 51 {\%} reported N to be similar in difficulty to reality. Of 28 participants who perform intraoperative cholangiograms, 43 {\%} found C to be more difficult than reality. Most (70 {\%}) participants thought the new tasks added value to FLS.CONCLUSIONS: This study provides preliminary validity evidence for the metrics of these new tasks. The value of adding these tasks to the FLS manual skills assessment is marginal in terms of predicting level of training.",
author = "Yusuke Watanabe and {Matt Ritter}, E. and Schwaitzberg, {Steven D.} and Korndorffer, {James R.} and Scott, {Daniel J.} and Allan Okrainec and Elif Bilgic and Kaneva, {Pepa A.} and O’Donnell, {Mary T.} and Feldman, {Liane S.} and Fried, {Gerald M.} and Vassiliou, {Melina C.}",
year = "2015",
month = "3",
day = "1",
doi = "10.1007/s00464-014-3721-5",
language = "English (US)",
volume = "29",
pages = "552--557",
journal = "Surgical Endoscopy and Other Interventional Techniques",
issn = "0930-2794",
publisher = "Springer New York",
number = "3",

}

TY - JOUR

T1 - Camera navigation and cannulation

T2 - validity evidence for new educational tasks to complement the Fundamentals of Laparoscopic Surgery program

AU - Watanabe, Yusuke

AU - Matt Ritter, E.

AU - Schwaitzberg, Steven D.

AU - Korndorffer, James R.

AU - Scott, Daniel J.

AU - Okrainec, Allan

AU - Bilgic, Elif

AU - Kaneva, Pepa A.

AU - O’Donnell, Mary T.

AU - Feldman, Liane S.

AU - Fried, Gerald M.

AU - Vassiliou, Melina C.

PY - 2015/3/1

Y1 - 2015/3/1

N2 - BACKGROUND: Experts identified camera navigation and cannulation as important skills that are not assessed by the Fundamentals of Laparoscopic Surgery (FLS) hands-on examination. The purpose of this study was to create metrics for and evaluate the validity for two new tasks: camera navigation (N) and cannulation (C), and to explore the potential value of adding these tasks to the FLS program.METHODS: Participants were assessed by two raters during performance of N and C in addition to the five standard FLS tasks. They also completed a questionnaire regarding the educational value of the new tasks. Validity evidence was assessed by comparing performance between Novice (PGY 1 and 2) and Experienced (PGY 3 and higher) participants, and by correlating new task scores with standard FLS scores. The ability to predict level of training using scores was evaluated by regression analysis.RESULTS: Sixty subjects participated from five North American centers. Inter-rater reliabilities for both tasks were 0.99. Novice and Experienced participants scored 74 ± 17.8 versus 85 ± 8.3 (p < 0.01) and 21 ± 17.3 versus 39 ± 20.1 (p < 0.01) on N and C tasks, respectively. Correlations with total FLS scores for N and C were 0.39 and 0.53, respectively. Prediction of training level using the combination of all seven tasks was 52.6 % (R (2) = 0.526, p < 0.01), adding an additional 2.2 % to the five FLS tasks. Of 55 participants with laparoscopic experience, 51 % reported N to be similar in difficulty to reality. Of 28 participants who perform intraoperative cholangiograms, 43 % found C to be more difficult than reality. Most (70 %) participants thought the new tasks added value to FLS.CONCLUSIONS: This study provides preliminary validity evidence for the metrics of these new tasks. The value of adding these tasks to the FLS manual skills assessment is marginal in terms of predicting level of training.

AB - BACKGROUND: Experts identified camera navigation and cannulation as important skills that are not assessed by the Fundamentals of Laparoscopic Surgery (FLS) hands-on examination. The purpose of this study was to create metrics for and evaluate the validity for two new tasks: camera navigation (N) and cannulation (C), and to explore the potential value of adding these tasks to the FLS program.METHODS: Participants were assessed by two raters during performance of N and C in addition to the five standard FLS tasks. They also completed a questionnaire regarding the educational value of the new tasks. Validity evidence was assessed by comparing performance between Novice (PGY 1 and 2) and Experienced (PGY 3 and higher) participants, and by correlating new task scores with standard FLS scores. The ability to predict level of training using scores was evaluated by regression analysis.RESULTS: Sixty subjects participated from five North American centers. Inter-rater reliabilities for both tasks were 0.99. Novice and Experienced participants scored 74 ± 17.8 versus 85 ± 8.3 (p < 0.01) and 21 ± 17.3 versus 39 ± 20.1 (p < 0.01) on N and C tasks, respectively. Correlations with total FLS scores for N and C were 0.39 and 0.53, respectively. Prediction of training level using the combination of all seven tasks was 52.6 % (R (2) = 0.526, p < 0.01), adding an additional 2.2 % to the five FLS tasks. Of 55 participants with laparoscopic experience, 51 % reported N to be similar in difficulty to reality. Of 28 participants who perform intraoperative cholangiograms, 43 % found C to be more difficult than reality. Most (70 %) participants thought the new tasks added value to FLS.CONCLUSIONS: This study provides preliminary validity evidence for the metrics of these new tasks. The value of adding these tasks to the FLS manual skills assessment is marginal in terms of predicting level of training.

UR - http://www.scopus.com/inward/record.url?scp=84996538525&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84996538525&partnerID=8YFLogxK

U2 - 10.1007/s00464-014-3721-5

DO - 10.1007/s00464-014-3721-5

M3 - Article

C2 - 25034381

AN - SCOPUS:84939889243

VL - 29

SP - 552

EP - 557

JO - Surgical Endoscopy and Other Interventional Techniques

JF - Surgical Endoscopy and Other Interventional Techniques

SN - 0930-2794

IS - 3

ER -