Evaluating Multisite rCBV Consistency from DSC-MRI Imaging Protocols and Postprocessing Software Across the NCI Quantitative Imaging Network Sites Using a Digital Reference Object (DRO)

Laura C. Bell, Natenael Semmineh, Hongyu An, Cihat Eldeniz, Richard Wahl, Kathleen M. Schmainda, Melissa A. Prah, Bradley J. Erickson, Panagiotis Korfiatis, Chengyue Wu, Anna G. Sorace, Thomas E. Yankeelov, Neal Rutledge, Thomas L. Chenevert, Dariya Malyarenko, Yichu Liu, Andrew Brenner, Leland S. Hu, Yuxiang Zhou, Jerrold L. BoxermanYi Fen Yen, Jayashree Kalpathy-Cramer, Andrew L. Beers, Mark Muzi, Ananth J. Madhuranthakam, Marco Pinho, Brian Johnson, C. Chad Quarles

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Relative cerebral blood volume (rCBV) cannot be used as a response metric in clinical trials, in part, because of variations in biomarker consistency and associated interpretation across sites, stemming from differences in image acquisition and postprocessing methods (PMs). This study leveraged a dynamic susceptibility contrast magnetic resonance imaging digital reference object to characterize rCBV consistency across 12 sites participating in the Quantitative Imaging Network (QIN), specifically focusing on differences in site-specific imaging protocols (IPs; n = 17), and PMs (n = 19) and differences due to site-specific IPs and PMs (n = 25). Thus, high agreement across sites occurs when 1 managing center processes rCBV despite slight variations in the IP. This result is most likely supported by current initiatives to standardize IPs. However, marked intersite disagreement was observed when site-specific software was applied for rCBV measurements. This study's results have important implications for comparing rCBV values across sites and trials, where variability in PMs could confound the comparison of therapeutic effectiveness and/or any attempts to establish thresholds for categorical response to therapy. To overcome these challenges and ensure the successful use of rCBV as a clinical trial biomarker, we recommend the establishment of qualifying and validating site- and trial-specific criteria for scanners and acquisition methods (eg, using a validated phantom) and the software tools used for dynamic susceptibility contrast magnetic resonance imaging analysis (eg, using a digital reference object where the ground truth is known).

Original languageEnglish (US)
Pages (from-to)110-117
Number of pages8
JournalTomography (Ann Arbor, Mich.)
Volume5
Issue number1
DOIs
StatePublished - Mar 1 2019

Fingerprint

Software
Biomarkers
Magnetic Resonance Imaging
Clinical Trials
Cerebral Blood Volume
Therapeutics

Keywords

  • DSC-MRI
  • multisite consistency
  • relative cerebral blood volume
  • reproducibility
  • standardization

Cite this

Evaluating Multisite rCBV Consistency from DSC-MRI Imaging Protocols and Postprocessing Software Across the NCI Quantitative Imaging Network Sites Using a Digital Reference Object (DRO). / Bell, Laura C.; Semmineh, Natenael; An, Hongyu; Eldeniz, Cihat; Wahl, Richard; Schmainda, Kathleen M.; Prah, Melissa A.; Erickson, Bradley J.; Korfiatis, Panagiotis; Wu, Chengyue; Sorace, Anna G.; Yankeelov, Thomas E.; Rutledge, Neal; Chenevert, Thomas L.; Malyarenko, Dariya; Liu, Yichu; Brenner, Andrew; Hu, Leland S.; Zhou, Yuxiang; Boxerman, Jerrold L.; Yen, Yi Fen; Kalpathy-Cramer, Jayashree; Beers, Andrew L.; Muzi, Mark; Madhuranthakam, Ananth J.; Pinho, Marco; Johnson, Brian; Quarles, C. Chad.

In: Tomography (Ann Arbor, Mich.), Vol. 5, No. 1, 01.03.2019, p. 110-117.

Research output: Contribution to journalArticle

Bell, LC, Semmineh, N, An, H, Eldeniz, C, Wahl, R, Schmainda, KM, Prah, MA, Erickson, BJ, Korfiatis, P, Wu, C, Sorace, AG, Yankeelov, TE, Rutledge, N, Chenevert, TL, Malyarenko, D, Liu, Y, Brenner, A, Hu, LS, Zhou, Y, Boxerman, JL, Yen, YF, Kalpathy-Cramer, J, Beers, AL, Muzi, M, Madhuranthakam, AJ, Pinho, M, Johnson, B & Quarles, CC 2019, 'Evaluating Multisite rCBV Consistency from DSC-MRI Imaging Protocols and Postprocessing Software Across the NCI Quantitative Imaging Network Sites Using a Digital Reference Object (DRO)', Tomography (Ann Arbor, Mich.), vol. 5, no. 1, pp. 110-117. https://doi.org/10.18383/j.tom.2018.00041
Bell, Laura C. ; Semmineh, Natenael ; An, Hongyu ; Eldeniz, Cihat ; Wahl, Richard ; Schmainda, Kathleen M. ; Prah, Melissa A. ; Erickson, Bradley J. ; Korfiatis, Panagiotis ; Wu, Chengyue ; Sorace, Anna G. ; Yankeelov, Thomas E. ; Rutledge, Neal ; Chenevert, Thomas L. ; Malyarenko, Dariya ; Liu, Yichu ; Brenner, Andrew ; Hu, Leland S. ; Zhou, Yuxiang ; Boxerman, Jerrold L. ; Yen, Yi Fen ; Kalpathy-Cramer, Jayashree ; Beers, Andrew L. ; Muzi, Mark ; Madhuranthakam, Ananth J. ; Pinho, Marco ; Johnson, Brian ; Quarles, C. Chad. / Evaluating Multisite rCBV Consistency from DSC-MRI Imaging Protocols and Postprocessing Software Across the NCI Quantitative Imaging Network Sites Using a Digital Reference Object (DRO). In: Tomography (Ann Arbor, Mich.). 2019 ; Vol. 5, No. 1. pp. 110-117.
@article{c516777d5dc947d4a8546012aa27d774,
title = "Evaluating Multisite rCBV Consistency from DSC-MRI Imaging Protocols and Postprocessing Software Across the NCI Quantitative Imaging Network Sites Using a Digital Reference Object (DRO)",
abstract = "Relative cerebral blood volume (rCBV) cannot be used as a response metric in clinical trials, in part, because of variations in biomarker consistency and associated interpretation across sites, stemming from differences in image acquisition and postprocessing methods (PMs). This study leveraged a dynamic susceptibility contrast magnetic resonance imaging digital reference object to characterize rCBV consistency across 12 sites participating in the Quantitative Imaging Network (QIN), specifically focusing on differences in site-specific imaging protocols (IPs; n = 17), and PMs (n = 19) and differences due to site-specific IPs and PMs (n = 25). Thus, high agreement across sites occurs when 1 managing center processes rCBV despite slight variations in the IP. This result is most likely supported by current initiatives to standardize IPs. However, marked intersite disagreement was observed when site-specific software was applied for rCBV measurements. This study's results have important implications for comparing rCBV values across sites and trials, where variability in PMs could confound the comparison of therapeutic effectiveness and/or any attempts to establish thresholds for categorical response to therapy. To overcome these challenges and ensure the successful use of rCBV as a clinical trial biomarker, we recommend the establishment of qualifying and validating site- and trial-specific criteria for scanners and acquisition methods (eg, using a validated phantom) and the software tools used for dynamic susceptibility contrast magnetic resonance imaging analysis (eg, using a digital reference object where the ground truth is known).",
keywords = "DSC-MRI, multisite consistency, relative cerebral blood volume, reproducibility, standardization",
author = "Bell, {Laura C.} and Natenael Semmineh and Hongyu An and Cihat Eldeniz and Richard Wahl and Schmainda, {Kathleen M.} and Prah, {Melissa A.} and Erickson, {Bradley J.} and Panagiotis Korfiatis and Chengyue Wu and Sorace, {Anna G.} and Yankeelov, {Thomas E.} and Neal Rutledge and Chenevert, {Thomas L.} and Dariya Malyarenko and Yichu Liu and Andrew Brenner and Hu, {Leland S.} and Yuxiang Zhou and Boxerman, {Jerrold L.} and Yen, {Yi Fen} and Jayashree Kalpathy-Cramer and Beers, {Andrew L.} and Mark Muzi and Madhuranthakam, {Ananth J.} and Marco Pinho and Brian Johnson and Quarles, {C. Chad}",
year = "2019",
month = "3",
day = "1",
doi = "10.18383/j.tom.2018.00041",
language = "English (US)",
volume = "5",
pages = "110--117",
journal = "Tomography (Ann Arbor, Mich.)",
issn = "2379-1381",
publisher = "Grapho Publications LLC",
number = "1",

}

TY - JOUR

T1 - Evaluating Multisite rCBV Consistency from DSC-MRI Imaging Protocols and Postprocessing Software Across the NCI Quantitative Imaging Network Sites Using a Digital Reference Object (DRO)

AU - Bell, Laura C.

AU - Semmineh, Natenael

AU - An, Hongyu

AU - Eldeniz, Cihat

AU - Wahl, Richard

AU - Schmainda, Kathleen M.

AU - Prah, Melissa A.

AU - Erickson, Bradley J.

AU - Korfiatis, Panagiotis

AU - Wu, Chengyue

AU - Sorace, Anna G.

AU - Yankeelov, Thomas E.

AU - Rutledge, Neal

AU - Chenevert, Thomas L.

AU - Malyarenko, Dariya

AU - Liu, Yichu

AU - Brenner, Andrew

AU - Hu, Leland S.

AU - Zhou, Yuxiang

AU - Boxerman, Jerrold L.

AU - Yen, Yi Fen

AU - Kalpathy-Cramer, Jayashree

AU - Beers, Andrew L.

AU - Muzi, Mark

AU - Madhuranthakam, Ananth J.

AU - Pinho, Marco

AU - Johnson, Brian

AU - Quarles, C. Chad

PY - 2019/3/1

Y1 - 2019/3/1

N2 - Relative cerebral blood volume (rCBV) cannot be used as a response metric in clinical trials, in part, because of variations in biomarker consistency and associated interpretation across sites, stemming from differences in image acquisition and postprocessing methods (PMs). This study leveraged a dynamic susceptibility contrast magnetic resonance imaging digital reference object to characterize rCBV consistency across 12 sites participating in the Quantitative Imaging Network (QIN), specifically focusing on differences in site-specific imaging protocols (IPs; n = 17), and PMs (n = 19) and differences due to site-specific IPs and PMs (n = 25). Thus, high agreement across sites occurs when 1 managing center processes rCBV despite slight variations in the IP. This result is most likely supported by current initiatives to standardize IPs. However, marked intersite disagreement was observed when site-specific software was applied for rCBV measurements. This study's results have important implications for comparing rCBV values across sites and trials, where variability in PMs could confound the comparison of therapeutic effectiveness and/or any attempts to establish thresholds for categorical response to therapy. To overcome these challenges and ensure the successful use of rCBV as a clinical trial biomarker, we recommend the establishment of qualifying and validating site- and trial-specific criteria for scanners and acquisition methods (eg, using a validated phantom) and the software tools used for dynamic susceptibility contrast magnetic resonance imaging analysis (eg, using a digital reference object where the ground truth is known).

AB - Relative cerebral blood volume (rCBV) cannot be used as a response metric in clinical trials, in part, because of variations in biomarker consistency and associated interpretation across sites, stemming from differences in image acquisition and postprocessing methods (PMs). This study leveraged a dynamic susceptibility contrast magnetic resonance imaging digital reference object to characterize rCBV consistency across 12 sites participating in the Quantitative Imaging Network (QIN), specifically focusing on differences in site-specific imaging protocols (IPs; n = 17), and PMs (n = 19) and differences due to site-specific IPs and PMs (n = 25). Thus, high agreement across sites occurs when 1 managing center processes rCBV despite slight variations in the IP. This result is most likely supported by current initiatives to standardize IPs. However, marked intersite disagreement was observed when site-specific software was applied for rCBV measurements. This study's results have important implications for comparing rCBV values across sites and trials, where variability in PMs could confound the comparison of therapeutic effectiveness and/or any attempts to establish thresholds for categorical response to therapy. To overcome these challenges and ensure the successful use of rCBV as a clinical trial biomarker, we recommend the establishment of qualifying and validating site- and trial-specific criteria for scanners and acquisition methods (eg, using a validated phantom) and the software tools used for dynamic susceptibility contrast magnetic resonance imaging analysis (eg, using a digital reference object where the ground truth is known).

KW - DSC-MRI

KW - multisite consistency

KW - relative cerebral blood volume

KW - reproducibility

KW - standardization

UR - http://www.scopus.com/inward/record.url?scp=85069176881&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85069176881&partnerID=8YFLogxK

U2 - 10.18383/j.tom.2018.00041

DO - 10.18383/j.tom.2018.00041

M3 - Article

C2 - 30854448

AN - SCOPUS:85069176881

VL - 5

SP - 110

EP - 117

JO - Tomography (Ann Arbor, Mich.)

JF - Tomography (Ann Arbor, Mich.)

SN - 2379-1381

IS - 1

ER -