Assessment of basic human performance resources predicts operative performance of laparoscopic surgery

Matthew T. Gettman, George V. Kondraske, Olivier Traxer, Ken Ogan, Cheryl Napper, Daniel B. Jones, Margaret S Pearle, Jeffrey A Cadeddu

Research output: Contribution to journalArticle

35 Citations (Scopus)

Abstract

Background Interest in laparoscopic surgery has prompted development of educational programs designed to teach and assess laparoscopic skills. Although these programs are beneficial, because of the inherent demands imposed by laparoscopy some aspects of operative performance might not improve with practice. This suggests that innate ability could predict level of operative skill. Assessment of operative and technical potential to date has relied largely on subjective rather than objective criteria. In this study, the relationships between objective measures of human basic performance resources (BPRs) and laparoscopic performance were evaluated using Nonlinear Causal Resource Analysis (NCRA), a novel predictive and explanatory modeling approach based on General Systems Performance Theory. Study design Twenty urology residents were voluntary enrolled. Thirteen validated BPRs were measured and analyzed relative to operative laparoscopic performance (assessed by two experts) of two porcine laparoscopic nephrectomies (LN). The laparoscopic procedure, representing a High Level Task (HLT), was evaluated using a modified Global Rating of Operative Performance Scale. NCRA models were devised to predict performance of the HLT laparoscopic nephrectomies based on BPRs and to determine the limiting performance resource. Results NCRA models predicted excellent agreement with actual operative performance, suggesting that measures of innate ability (or BPRs) predicted performance of laparoscopic nephrectomy. In 65%, the prediction by NCRA was near identical to the expert rating on the HLT. In 25% of cases, NCRA overpredicted performance; in 10%, NCRA underpredicted performance of the HLT compared to the subjective ratings. Neuromotor channel capacity was the most common performance-limiting resource. Conclusions Preliminary findings suggest objective prediction of laparoscopic performance with limiting resource diagnostics for an individual surgeon is possible and practical using appropriate new measurement and modeling methods. Selection of surgical candidates, training, and educational curriculum could be positively affected.

Original languageEnglish (US)
Pages (from-to)489-496
Number of pages8
JournalJournal of the American College of Surgeons
Volume197
Issue number3
DOIs
StatePublished - Sep 2003

Fingerprint

Nephrectomy
Laparoscopy
Systems Theory
Program Development
Urology
Curriculum
Swine

Keywords

  • Basic Element of Performance (refers to testing modules)
  • Basic Performance Resource
  • BEP
  • BPR
  • General Systems Performance Theory
  • GSPT
  • High level task
  • HLT
  • Laparoscopic nephrectomy
  • LN
  • NCRA
  • Nonlinear Causal Resource Analysis
  • RDF
  • Resource Demand Function

ASJC Scopus subject areas

  • Surgery

Cite this

Assessment of basic human performance resources predicts operative performance of laparoscopic surgery. / Gettman, Matthew T.; Kondraske, George V.; Traxer, Olivier; Ogan, Ken; Napper, Cheryl; Jones, Daniel B.; Pearle, Margaret S; Cadeddu, Jeffrey A.

In: Journal of the American College of Surgeons, Vol. 197, No. 3, 09.2003, p. 489-496.

Research output: Contribution to journalArticle

Gettman, Matthew T. ; Kondraske, George V. ; Traxer, Olivier ; Ogan, Ken ; Napper, Cheryl ; Jones, Daniel B. ; Pearle, Margaret S ; Cadeddu, Jeffrey A. / Assessment of basic human performance resources predicts operative performance of laparoscopic surgery. In: Journal of the American College of Surgeons. 2003 ; Vol. 197, No. 3. pp. 489-496.
@article{74ed7e5c080749ac8912d0e6f650d32f,
title = "Assessment of basic human performance resources predicts operative performance of laparoscopic surgery",
abstract = "Background Interest in laparoscopic surgery has prompted development of educational programs designed to teach and assess laparoscopic skills. Although these programs are beneficial, because of the inherent demands imposed by laparoscopy some aspects of operative performance might not improve with practice. This suggests that innate ability could predict level of operative skill. Assessment of operative and technical potential to date has relied largely on subjective rather than objective criteria. In this study, the relationships between objective measures of human basic performance resources (BPRs) and laparoscopic performance were evaluated using Nonlinear Causal Resource Analysis (NCRA), a novel predictive and explanatory modeling approach based on General Systems Performance Theory. Study design Twenty urology residents were voluntary enrolled. Thirteen validated BPRs were measured and analyzed relative to operative laparoscopic performance (assessed by two experts) of two porcine laparoscopic nephrectomies (LN). The laparoscopic procedure, representing a High Level Task (HLT), was evaluated using a modified Global Rating of Operative Performance Scale. NCRA models were devised to predict performance of the HLT laparoscopic nephrectomies based on BPRs and to determine the limiting performance resource. Results NCRA models predicted excellent agreement with actual operative performance, suggesting that measures of innate ability (or BPRs) predicted performance of laparoscopic nephrectomy. In 65{\%}, the prediction by NCRA was near identical to the expert rating on the HLT. In 25{\%} of cases, NCRA overpredicted performance; in 10{\%}, NCRA underpredicted performance of the HLT compared to the subjective ratings. Neuromotor channel capacity was the most common performance-limiting resource. Conclusions Preliminary findings suggest objective prediction of laparoscopic performance with limiting resource diagnostics for an individual surgeon is possible and practical using appropriate new measurement and modeling methods. Selection of surgical candidates, training, and educational curriculum could be positively affected.",
keywords = "Basic Element of Performance (refers to testing modules), Basic Performance Resource, BEP, BPR, General Systems Performance Theory, GSPT, High level task, HLT, Laparoscopic nephrectomy, LN, NCRA, Nonlinear Causal Resource Analysis, RDF, Resource Demand Function",
author = "Gettman, {Matthew T.} and Kondraske, {George V.} and Olivier Traxer and Ken Ogan and Cheryl Napper and Jones, {Daniel B.} and Pearle, {Margaret S} and Cadeddu, {Jeffrey A}",
year = "2003",
month = "9",
doi = "10.1016/S1072-7515(03)00333-8",
language = "English (US)",
volume = "197",
pages = "489--496",
journal = "Journal of the American College of Surgeons",
issn = "1072-7515",
publisher = "Elsevier Inc.",
number = "3",

}

TY - JOUR

T1 - Assessment of basic human performance resources predicts operative performance of laparoscopic surgery

AU - Gettman, Matthew T.

AU - Kondraske, George V.

AU - Traxer, Olivier

AU - Ogan, Ken

AU - Napper, Cheryl

AU - Jones, Daniel B.

AU - Pearle, Margaret S

AU - Cadeddu, Jeffrey A

PY - 2003/9

Y1 - 2003/9

N2 - Background Interest in laparoscopic surgery has prompted development of educational programs designed to teach and assess laparoscopic skills. Although these programs are beneficial, because of the inherent demands imposed by laparoscopy some aspects of operative performance might not improve with practice. This suggests that innate ability could predict level of operative skill. Assessment of operative and technical potential to date has relied largely on subjective rather than objective criteria. In this study, the relationships between objective measures of human basic performance resources (BPRs) and laparoscopic performance were evaluated using Nonlinear Causal Resource Analysis (NCRA), a novel predictive and explanatory modeling approach based on General Systems Performance Theory. Study design Twenty urology residents were voluntary enrolled. Thirteen validated BPRs were measured and analyzed relative to operative laparoscopic performance (assessed by two experts) of two porcine laparoscopic nephrectomies (LN). The laparoscopic procedure, representing a High Level Task (HLT), was evaluated using a modified Global Rating of Operative Performance Scale. NCRA models were devised to predict performance of the HLT laparoscopic nephrectomies based on BPRs and to determine the limiting performance resource. Results NCRA models predicted excellent agreement with actual operative performance, suggesting that measures of innate ability (or BPRs) predicted performance of laparoscopic nephrectomy. In 65%, the prediction by NCRA was near identical to the expert rating on the HLT. In 25% of cases, NCRA overpredicted performance; in 10%, NCRA underpredicted performance of the HLT compared to the subjective ratings. Neuromotor channel capacity was the most common performance-limiting resource. Conclusions Preliminary findings suggest objective prediction of laparoscopic performance with limiting resource diagnostics for an individual surgeon is possible and practical using appropriate new measurement and modeling methods. Selection of surgical candidates, training, and educational curriculum could be positively affected.

AB - Background Interest in laparoscopic surgery has prompted development of educational programs designed to teach and assess laparoscopic skills. Although these programs are beneficial, because of the inherent demands imposed by laparoscopy some aspects of operative performance might not improve with practice. This suggests that innate ability could predict level of operative skill. Assessment of operative and technical potential to date has relied largely on subjective rather than objective criteria. In this study, the relationships between objective measures of human basic performance resources (BPRs) and laparoscopic performance were evaluated using Nonlinear Causal Resource Analysis (NCRA), a novel predictive and explanatory modeling approach based on General Systems Performance Theory. Study design Twenty urology residents were voluntary enrolled. Thirteen validated BPRs were measured and analyzed relative to operative laparoscopic performance (assessed by two experts) of two porcine laparoscopic nephrectomies (LN). The laparoscopic procedure, representing a High Level Task (HLT), was evaluated using a modified Global Rating of Operative Performance Scale. NCRA models were devised to predict performance of the HLT laparoscopic nephrectomies based on BPRs and to determine the limiting performance resource. Results NCRA models predicted excellent agreement with actual operative performance, suggesting that measures of innate ability (or BPRs) predicted performance of laparoscopic nephrectomy. In 65%, the prediction by NCRA was near identical to the expert rating on the HLT. In 25% of cases, NCRA overpredicted performance; in 10%, NCRA underpredicted performance of the HLT compared to the subjective ratings. Neuromotor channel capacity was the most common performance-limiting resource. Conclusions Preliminary findings suggest objective prediction of laparoscopic performance with limiting resource diagnostics for an individual surgeon is possible and practical using appropriate new measurement and modeling methods. Selection of surgical candidates, training, and educational curriculum could be positively affected.

KW - Basic Element of Performance (refers to testing modules)

KW - Basic Performance Resource

KW - BEP

KW - BPR

KW - General Systems Performance Theory

KW - GSPT

KW - High level task

KW - HLT

KW - Laparoscopic nephrectomy

KW - LN

KW - NCRA

KW - Nonlinear Causal Resource Analysis

KW - RDF

KW - Resource Demand Function

UR - http://www.scopus.com/inward/record.url?scp=0141610010&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0141610010&partnerID=8YFLogxK

U2 - 10.1016/S1072-7515(03)00333-8

DO - 10.1016/S1072-7515(03)00333-8

M3 - Article

VL - 197

SP - 489

EP - 496

JO - Journal of the American College of Surgeons

JF - Journal of the American College of Surgeons

SN - 1072-7515

IS - 3

ER -