Grading of surgeon technical performance predicts postoperative pancreatic fistula for pancreaticoduodenectomy independent of patient-related variables

Melissa E. Hogg, Mazen Zenati, Stephanie Novak, Yong Chen, Yan Jun, Jennifer Steve, Stacy J. Kowalsky, David L. Bartlett, Amer H. Zureikat, Herbert J. Zeh

Research output: Contribution to journalArticle

25 Citations (Scopus)

Abstract

Objective: To evaluate and quantify surgical skill by grading surgical performance of the pancreaticojejunostomy from robotic pancreaticoduodenectomies (RPDs). We hypothesized that video grading of surgical performance would contribute to estimating risk of postoperative pancreatic fistula (POPF) after pancreaticoduodenectomy. Background: POPF majorly contributes to pancreaticoduodenectomy morbidity. Risk scores [Fistula Risk Score (FRS) and Braga] derived from patient variables are validated for predicting POPF. Birkmeyer et al showed assessment of surgical proficiency is an important component of outcomes. Methods: POPF was diagnosed using International Study Group definition. Technical performance of robotic pancreaticojejunostomy video was graded by 2 blinded surgeons using: (1) pancreaticojejunostomy step-by-step variables [PJ-specific variables (PJVs); max = 115]; and (2) the Objective Structured Assessment of Technical Skills (OSATS) score. Results: One hundred thirty-three pancreaticojejunostomies were analyzed. POPF was 18%. Higher FRS (P = 0.011) and Braga (P = 0.041) scores predicted POPF. Graders' subjective prediction did not correlate with FRS/ Braga scores. Grader 1 scores (P = 0.043), but not grader 2 (P = 0.44), predicted POPF. PJV scores >105 were predictive of POPF (P = 0.039). Scoring only PJV duct-to-mucosa stitches (max = 50) was highly predictive of POPF (P = 0.0053). Higher OSATS scores were associated with a decreased rate of POPF (P = 0.022). On multivariate analysis, adding technical scoring to statistically significant patient variables (ie, gland texture) improves the model and can independently predict POPF. The strongest predictive model for POPF consisted of soft gland (odds ratio = 18.28, 95% confidence interval = 2.19-152.57) and low OSATS (odds ratio = 0.82, 95% confidence interval = 0.70-0.96). OSATS, modeled with FRS or Braga scores, independently predicted POPF. Conclusions: This is the first study to demonstrate that technical scoring of a surgeon's performance independently predicts patient outcomes in pancreatic surgery. Future studies should consider how to validate and incorporate technical metrics.

Original languageEnglish (US)
Pages (from-to)482-489
Number of pages8
JournalAnnals of surgery
Volume264
Issue number3
DOIs
StatePublished - Sep 1 2016
Externally publishedYes

Fingerprint

Pancreatic Fistula
Pancreaticoduodenectomy
Pancreaticojejunostomy
Fistula
Robotics
Surgeons
Odds Ratio
Confidence Intervals

Keywords

  • OSATS
  • Pancreatic fistula
  • Pancreaticoduodenectomy
  • Pancreaticojejunostomy
  • Robotic-assisted surgery
  • Surgical proficiency

ASJC Scopus subject areas

  • Surgery

Cite this

Grading of surgeon technical performance predicts postoperative pancreatic fistula for pancreaticoduodenectomy independent of patient-related variables. / Hogg, Melissa E.; Zenati, Mazen; Novak, Stephanie; Chen, Yong; Jun, Yan; Steve, Jennifer; Kowalsky, Stacy J.; Bartlett, David L.; Zureikat, Amer H.; Zeh, Herbert J.

In: Annals of surgery, Vol. 264, No. 3, 01.09.2016, p. 482-489.

Research output: Contribution to journalArticle

Hogg, Melissa E. ; Zenati, Mazen ; Novak, Stephanie ; Chen, Yong ; Jun, Yan ; Steve, Jennifer ; Kowalsky, Stacy J. ; Bartlett, David L. ; Zureikat, Amer H. ; Zeh, Herbert J. / Grading of surgeon technical performance predicts postoperative pancreatic fistula for pancreaticoduodenectomy independent of patient-related variables. In: Annals of surgery. 2016 ; Vol. 264, No. 3. pp. 482-489.
@article{f39b53ade3f24c3986404f1536c9dd34,
title = "Grading of surgeon technical performance predicts postoperative pancreatic fistula for pancreaticoduodenectomy independent of patient-related variables",
abstract = "Objective: To evaluate and quantify surgical skill by grading surgical performance of the pancreaticojejunostomy from robotic pancreaticoduodenectomies (RPDs). We hypothesized that video grading of surgical performance would contribute to estimating risk of postoperative pancreatic fistula (POPF) after pancreaticoduodenectomy. Background: POPF majorly contributes to pancreaticoduodenectomy morbidity. Risk scores [Fistula Risk Score (FRS) and Braga] derived from patient variables are validated for predicting POPF. Birkmeyer et al showed assessment of surgical proficiency is an important component of outcomes. Methods: POPF was diagnosed using International Study Group definition. Technical performance of robotic pancreaticojejunostomy video was graded by 2 blinded surgeons using: (1) pancreaticojejunostomy step-by-step variables [PJ-specific variables (PJVs); max = 115]; and (2) the Objective Structured Assessment of Technical Skills (OSATS) score. Results: One hundred thirty-three pancreaticojejunostomies were analyzed. POPF was 18{\%}. Higher FRS (P = 0.011) and Braga (P = 0.041) scores predicted POPF. Graders' subjective prediction did not correlate with FRS/ Braga scores. Grader 1 scores (P = 0.043), but not grader 2 (P = 0.44), predicted POPF. PJV scores >105 were predictive of POPF (P = 0.039). Scoring only PJV duct-to-mucosa stitches (max = 50) was highly predictive of POPF (P = 0.0053). Higher OSATS scores were associated with a decreased rate of POPF (P = 0.022). On multivariate analysis, adding technical scoring to statistically significant patient variables (ie, gland texture) improves the model and can independently predict POPF. The strongest predictive model for POPF consisted of soft gland (odds ratio = 18.28, 95{\%} confidence interval = 2.19-152.57) and low OSATS (odds ratio = 0.82, 95{\%} confidence interval = 0.70-0.96). OSATS, modeled with FRS or Braga scores, independently predicted POPF. Conclusions: This is the first study to demonstrate that technical scoring of a surgeon's performance independently predicts patient outcomes in pancreatic surgery. Future studies should consider how to validate and incorporate technical metrics.",
keywords = "OSATS, Pancreatic fistula, Pancreaticoduodenectomy, Pancreaticojejunostomy, Robotic-assisted surgery, Surgical proficiency",
author = "Hogg, {Melissa E.} and Mazen Zenati and Stephanie Novak and Yong Chen and Yan Jun and Jennifer Steve and Kowalsky, {Stacy J.} and Bartlett, {David L.} and Zureikat, {Amer H.} and Zeh, {Herbert J.}",
year = "2016",
month = "9",
day = "1",
doi = "10.1097/SLA.0000000000001862",
language = "English (US)",
volume = "264",
pages = "482--489",
journal = "Annals of Surgery",
issn = "0003-4932",
publisher = "Lippincott Williams and Wilkins",
number = "3",

}

TY - JOUR

T1 - Grading of surgeon technical performance predicts postoperative pancreatic fistula for pancreaticoduodenectomy independent of patient-related variables

AU - Hogg, Melissa E.

AU - Zenati, Mazen

AU - Novak, Stephanie

AU - Chen, Yong

AU - Jun, Yan

AU - Steve, Jennifer

AU - Kowalsky, Stacy J.

AU - Bartlett, David L.

AU - Zureikat, Amer H.

AU - Zeh, Herbert J.

PY - 2016/9/1

Y1 - 2016/9/1

N2 - Objective: To evaluate and quantify surgical skill by grading surgical performance of the pancreaticojejunostomy from robotic pancreaticoduodenectomies (RPDs). We hypothesized that video grading of surgical performance would contribute to estimating risk of postoperative pancreatic fistula (POPF) after pancreaticoduodenectomy. Background: POPF majorly contributes to pancreaticoduodenectomy morbidity. Risk scores [Fistula Risk Score (FRS) and Braga] derived from patient variables are validated for predicting POPF. Birkmeyer et al showed assessment of surgical proficiency is an important component of outcomes. Methods: POPF was diagnosed using International Study Group definition. Technical performance of robotic pancreaticojejunostomy video was graded by 2 blinded surgeons using: (1) pancreaticojejunostomy step-by-step variables [PJ-specific variables (PJVs); max = 115]; and (2) the Objective Structured Assessment of Technical Skills (OSATS) score. Results: One hundred thirty-three pancreaticojejunostomies were analyzed. POPF was 18%. Higher FRS (P = 0.011) and Braga (P = 0.041) scores predicted POPF. Graders' subjective prediction did not correlate with FRS/ Braga scores. Grader 1 scores (P = 0.043), but not grader 2 (P = 0.44), predicted POPF. PJV scores >105 were predictive of POPF (P = 0.039). Scoring only PJV duct-to-mucosa stitches (max = 50) was highly predictive of POPF (P = 0.0053). Higher OSATS scores were associated with a decreased rate of POPF (P = 0.022). On multivariate analysis, adding technical scoring to statistically significant patient variables (ie, gland texture) improves the model and can independently predict POPF. The strongest predictive model for POPF consisted of soft gland (odds ratio = 18.28, 95% confidence interval = 2.19-152.57) and low OSATS (odds ratio = 0.82, 95% confidence interval = 0.70-0.96). OSATS, modeled with FRS or Braga scores, independently predicted POPF. Conclusions: This is the first study to demonstrate that technical scoring of a surgeon's performance independently predicts patient outcomes in pancreatic surgery. Future studies should consider how to validate and incorporate technical metrics.

AB - Objective: To evaluate and quantify surgical skill by grading surgical performance of the pancreaticojejunostomy from robotic pancreaticoduodenectomies (RPDs). We hypothesized that video grading of surgical performance would contribute to estimating risk of postoperative pancreatic fistula (POPF) after pancreaticoduodenectomy. Background: POPF majorly contributes to pancreaticoduodenectomy morbidity. Risk scores [Fistula Risk Score (FRS) and Braga] derived from patient variables are validated for predicting POPF. Birkmeyer et al showed assessment of surgical proficiency is an important component of outcomes. Methods: POPF was diagnosed using International Study Group definition. Technical performance of robotic pancreaticojejunostomy video was graded by 2 blinded surgeons using: (1) pancreaticojejunostomy step-by-step variables [PJ-specific variables (PJVs); max = 115]; and (2) the Objective Structured Assessment of Technical Skills (OSATS) score. Results: One hundred thirty-three pancreaticojejunostomies were analyzed. POPF was 18%. Higher FRS (P = 0.011) and Braga (P = 0.041) scores predicted POPF. Graders' subjective prediction did not correlate with FRS/ Braga scores. Grader 1 scores (P = 0.043), but not grader 2 (P = 0.44), predicted POPF. PJV scores >105 were predictive of POPF (P = 0.039). Scoring only PJV duct-to-mucosa stitches (max = 50) was highly predictive of POPF (P = 0.0053). Higher OSATS scores were associated with a decreased rate of POPF (P = 0.022). On multivariate analysis, adding technical scoring to statistically significant patient variables (ie, gland texture) improves the model and can independently predict POPF. The strongest predictive model for POPF consisted of soft gland (odds ratio = 18.28, 95% confidence interval = 2.19-152.57) and low OSATS (odds ratio = 0.82, 95% confidence interval = 0.70-0.96). OSATS, modeled with FRS or Braga scores, independently predicted POPF. Conclusions: This is the first study to demonstrate that technical scoring of a surgeon's performance independently predicts patient outcomes in pancreatic surgery. Future studies should consider how to validate and incorporate technical metrics.

KW - OSATS

KW - Pancreatic fistula

KW - Pancreaticoduodenectomy

KW - Pancreaticojejunostomy

KW - Robotic-assisted surgery

KW - Surgical proficiency

UR - http://www.scopus.com/inward/record.url?scp=84978705147&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84978705147&partnerID=8YFLogxK

U2 - 10.1097/SLA.0000000000001862

DO - 10.1097/SLA.0000000000001862

M3 - Article

C2 - 27433897

AN - SCOPUS:84978705147

VL - 264

SP - 482

EP - 489

JO - Annals of Surgery

JF - Annals of Surgery

SN - 0003-4932

IS - 3

ER -