Simple visual review of pre- to post-operative renal ultrasound images predicts pyeloplasty success equally as well as geometric measurements

A blinded comparison with a gold standard

Adam J.M. Kern, Bruce J Schlomer, Matthew D. Timberlake, Craig A Peters, Matthew R Hammer, Micah A Jacobs

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Background: MAG3 diuretic renal scan remains the gold standard for determination of improvement in renal drainage following pyeloplasty for ureteropelvic junction obstruction. We hypothesized that (i) a change in geometric measurements between pre-operative and post-operative renal ultrasound (RUS) images and (ii) blinded simple visual review of images both would predict pyeloplasty success. Objective: To determine if simple visual review and/or novel geometric measurement of renal ultrasounds can detect pyeloplasty failure. Study design: This study was a retrospective, blinded comparison with a gold standard. Included were children aged ≤18 years undergoing pyeloplasty at our institution from 2009 to 2015. For each kidney, representative pre-operative and post-operative RUS images were chosen. Our standard for pyeloplasty success was improved drainage curve on MAG3 and lack of additional surgery. Measurements for collecting system circularity, roundness, and renal parenchymal to collecting system area ratio (RPCSR) were obtained by three raters (Figure), who were blinded to the outcome of the pyeloplasty. Changes in geometric measurements were analyzed as a diagnostic test for MAG3-defined pyeloplasty success using ROC curve analysis. In addition, six reviewers blinded to pyeloplasty success reviewed pre-operative and post-operative images visually for improved hydronephrosis and categorized pyeloplasty as success or failure based on simple visual review of RUS. Results: Fifty-three repaired renal units were identified (50 children). There were five pyeloplasty failures, four of which underwent revision or nephrectomy. While all geometric measurements could discriminate pyeloplasty failure and success, the geometric measurements that discriminated best between pyeloplasty failure and success were change in collecting system roundness and change in RPCSR. Consensus opinion among six blinded reviewers using simple visual review had a sensitivity of 94% and PPV of 100% with respect to identifying pyeloplasty success (AUC 0.97 (95% CI 0.93-1.0)). This was not significantly different from AUC for change in roundness (p = 0.09) or change in RPCSR (p = 0.1). Discussion: Change in collecting system roundness and change in RPCSR were the most accurate geometric measurements in predicting pyeloplasty success. Simple visual review of ultrasound images for pyeloplasty success performed as well or better than geometric measurements. However, geometric measurements remain useful as a research tool or to communicate findings between clinicians. Conclusions: Complex geometric measurements of hydronephrosis or post-operative MAG3 scans are not needed if hydronephrosis is visually significantly improved, as simple visual review is highly sensitive for detecting pyeloplasty failure.Display Omitted.

Original languageEnglish (US)
JournalJournal of Pediatric Urology
DOIs
StateAccepted/In press - Jan 1 2017

Fingerprint

Kidney
Hydronephrosis
ROC Curve
Area Under Curve
Drainage
Nephrectomy
Diuretics
Routine Diagnostic Tests
Research

Keywords

  • Hydronephrosis
  • Image analysis
  • Kidney
  • Ultrasonography
  • Ureteropelvic junction obstruction

ASJC Scopus subject areas

  • Pediatrics, Perinatology, and Child Health
  • Urology

Cite this

@article{2be9b85a73714e68bcf94c9c5f164d2d,
title = "Simple visual review of pre- to post-operative renal ultrasound images predicts pyeloplasty success equally as well as geometric measurements: A blinded comparison with a gold standard",
abstract = "Background: MAG3 diuretic renal scan remains the gold standard for determination of improvement in renal drainage following pyeloplasty for ureteropelvic junction obstruction. We hypothesized that (i) a change in geometric measurements between pre-operative and post-operative renal ultrasound (RUS) images and (ii) blinded simple visual review of images both would predict pyeloplasty success. Objective: To determine if simple visual review and/or novel geometric measurement of renal ultrasounds can detect pyeloplasty failure. Study design: This study was a retrospective, blinded comparison with a gold standard. Included were children aged ≤18 years undergoing pyeloplasty at our institution from 2009 to 2015. For each kidney, representative pre-operative and post-operative RUS images were chosen. Our standard for pyeloplasty success was improved drainage curve on MAG3 and lack of additional surgery. Measurements for collecting system circularity, roundness, and renal parenchymal to collecting system area ratio (RPCSR) were obtained by three raters (Figure), who were blinded to the outcome of the pyeloplasty. Changes in geometric measurements were analyzed as a diagnostic test for MAG3-defined pyeloplasty success using ROC curve analysis. In addition, six reviewers blinded to pyeloplasty success reviewed pre-operative and post-operative images visually for improved hydronephrosis and categorized pyeloplasty as success or failure based on simple visual review of RUS. Results: Fifty-three repaired renal units were identified (50 children). There were five pyeloplasty failures, four of which underwent revision or nephrectomy. While all geometric measurements could discriminate pyeloplasty failure and success, the geometric measurements that discriminated best between pyeloplasty failure and success were change in collecting system roundness and change in RPCSR. Consensus opinion among six blinded reviewers using simple visual review had a sensitivity of 94{\%} and PPV of 100{\%} with respect to identifying pyeloplasty success (AUC 0.97 (95{\%} CI 0.93-1.0)). This was not significantly different from AUC for change in roundness (p = 0.09) or change in RPCSR (p = 0.1). Discussion: Change in collecting system roundness and change in RPCSR were the most accurate geometric measurements in predicting pyeloplasty success. Simple visual review of ultrasound images for pyeloplasty success performed as well or better than geometric measurements. However, geometric measurements remain useful as a research tool or to communicate findings between clinicians. Conclusions: Complex geometric measurements of hydronephrosis or post-operative MAG3 scans are not needed if hydronephrosis is visually significantly improved, as simple visual review is highly sensitive for detecting pyeloplasty failure.Display Omitted.",
keywords = "Hydronephrosis, Image analysis, Kidney, Ultrasonography, Ureteropelvic junction obstruction",
author = "Kern, {Adam J.M.} and Schlomer, {Bruce J} and Timberlake, {Matthew D.} and Peters, {Craig A} and Hammer, {Matthew R} and Jacobs, {Micah A}",
year = "2017",
month = "1",
day = "1",
doi = "10.1016/j.jpurol.2017.04.005",
language = "English (US)",
journal = "Journal of Pediatric Urology",
issn = "1477-5131",
publisher = "Elsevier BV",

}

TY - JOUR

T1 - Simple visual review of pre- to post-operative renal ultrasound images predicts pyeloplasty success equally as well as geometric measurements

T2 - A blinded comparison with a gold standard

AU - Kern, Adam J.M.

AU - Schlomer, Bruce J

AU - Timberlake, Matthew D.

AU - Peters, Craig A

AU - Hammer, Matthew R

AU - Jacobs, Micah A

PY - 2017/1/1

Y1 - 2017/1/1

N2 - Background: MAG3 diuretic renal scan remains the gold standard for determination of improvement in renal drainage following pyeloplasty for ureteropelvic junction obstruction. We hypothesized that (i) a change in geometric measurements between pre-operative and post-operative renal ultrasound (RUS) images and (ii) blinded simple visual review of images both would predict pyeloplasty success. Objective: To determine if simple visual review and/or novel geometric measurement of renal ultrasounds can detect pyeloplasty failure. Study design: This study was a retrospective, blinded comparison with a gold standard. Included were children aged ≤18 years undergoing pyeloplasty at our institution from 2009 to 2015. For each kidney, representative pre-operative and post-operative RUS images were chosen. Our standard for pyeloplasty success was improved drainage curve on MAG3 and lack of additional surgery. Measurements for collecting system circularity, roundness, and renal parenchymal to collecting system area ratio (RPCSR) were obtained by three raters (Figure), who were blinded to the outcome of the pyeloplasty. Changes in geometric measurements were analyzed as a diagnostic test for MAG3-defined pyeloplasty success using ROC curve analysis. In addition, six reviewers blinded to pyeloplasty success reviewed pre-operative and post-operative images visually for improved hydronephrosis and categorized pyeloplasty as success or failure based on simple visual review of RUS. Results: Fifty-three repaired renal units were identified (50 children). There were five pyeloplasty failures, four of which underwent revision or nephrectomy. While all geometric measurements could discriminate pyeloplasty failure and success, the geometric measurements that discriminated best between pyeloplasty failure and success were change in collecting system roundness and change in RPCSR. Consensus opinion among six blinded reviewers using simple visual review had a sensitivity of 94% and PPV of 100% with respect to identifying pyeloplasty success (AUC 0.97 (95% CI 0.93-1.0)). This was not significantly different from AUC for change in roundness (p = 0.09) or change in RPCSR (p = 0.1). Discussion: Change in collecting system roundness and change in RPCSR were the most accurate geometric measurements in predicting pyeloplasty success. Simple visual review of ultrasound images for pyeloplasty success performed as well or better than geometric measurements. However, geometric measurements remain useful as a research tool or to communicate findings between clinicians. Conclusions: Complex geometric measurements of hydronephrosis or post-operative MAG3 scans are not needed if hydronephrosis is visually significantly improved, as simple visual review is highly sensitive for detecting pyeloplasty failure.Display Omitted.

AB - Background: MAG3 diuretic renal scan remains the gold standard for determination of improvement in renal drainage following pyeloplasty for ureteropelvic junction obstruction. We hypothesized that (i) a change in geometric measurements between pre-operative and post-operative renal ultrasound (RUS) images and (ii) blinded simple visual review of images both would predict pyeloplasty success. Objective: To determine if simple visual review and/or novel geometric measurement of renal ultrasounds can detect pyeloplasty failure. Study design: This study was a retrospective, blinded comparison with a gold standard. Included were children aged ≤18 years undergoing pyeloplasty at our institution from 2009 to 2015. For each kidney, representative pre-operative and post-operative RUS images were chosen. Our standard for pyeloplasty success was improved drainage curve on MAG3 and lack of additional surgery. Measurements for collecting system circularity, roundness, and renal parenchymal to collecting system area ratio (RPCSR) were obtained by three raters (Figure), who were blinded to the outcome of the pyeloplasty. Changes in geometric measurements were analyzed as a diagnostic test for MAG3-defined pyeloplasty success using ROC curve analysis. In addition, six reviewers blinded to pyeloplasty success reviewed pre-operative and post-operative images visually for improved hydronephrosis and categorized pyeloplasty as success or failure based on simple visual review of RUS. Results: Fifty-three repaired renal units were identified (50 children). There were five pyeloplasty failures, four of which underwent revision or nephrectomy. While all geometric measurements could discriminate pyeloplasty failure and success, the geometric measurements that discriminated best between pyeloplasty failure and success were change in collecting system roundness and change in RPCSR. Consensus opinion among six blinded reviewers using simple visual review had a sensitivity of 94% and PPV of 100% with respect to identifying pyeloplasty success (AUC 0.97 (95% CI 0.93-1.0)). This was not significantly different from AUC for change in roundness (p = 0.09) or change in RPCSR (p = 0.1). Discussion: Change in collecting system roundness and change in RPCSR were the most accurate geometric measurements in predicting pyeloplasty success. Simple visual review of ultrasound images for pyeloplasty success performed as well or better than geometric measurements. However, geometric measurements remain useful as a research tool or to communicate findings between clinicians. Conclusions: Complex geometric measurements of hydronephrosis or post-operative MAG3 scans are not needed if hydronephrosis is visually significantly improved, as simple visual review is highly sensitive for detecting pyeloplasty failure.Display Omitted.

KW - Hydronephrosis

KW - Image analysis

KW - Kidney

KW - Ultrasonography

KW - Ureteropelvic junction obstruction

UR - http://www.scopus.com/inward/record.url?scp=85018881591&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85018881591&partnerID=8YFLogxK

U2 - 10.1016/j.jpurol.2017.04.005

DO - 10.1016/j.jpurol.2017.04.005

M3 - Article

JO - Journal of Pediatric Urology

JF - Journal of Pediatric Urology

SN - 1477-5131

ER -