Accuracy and reliability assessment of CT and MR perfusion analysis software using a digital phantom

Kohsuke Kudo, Soren Christensen, Makoto Sasaki, Leif Østergaard, Hiroki Shirato, Kuniaki Ogasawara, Max Wintermark, Steven Warach

Research output: Contribution to journalArticle

76 Citations (Scopus)

Abstract

Purpose: To design a digital phantom data set for computed tomography (CT) perfusion and perfusion-weighted imaging on the basis of the widely accepted tracer kinetic theory in which the true values of cerebral blood flow (CBF), cerebral blood volume (CBV), mean transit time (MTT), and tracer arrival delay are known and to evaluate the accuracy and reliability of postprocessing programs using this digital phantom. Materials and Methods: A phantom data set was created by generating concentration-time curves reflecting true values for CBF (2.5-87.5 mL/100 g per minute), CBV (1.0-5.0 mL/100 g), MTT (3.4-24 seconds), and tracer delays (0-3.0 seconds). These curves were embedded in human brain images. The data were analyzed by using 13 algorithms each for CT and magnetic resonance (MR), including five commercial vendors and five academic programs. Accuracy was assessed by using the Pearson correlation coefficient (r) for true values. Delay-, MTT-, or CBV-dependent errors and correlations between time to maximum of residue function (Tmax) were also evaluated. Results: In CT, CBV was generally well reproduced (r > 0.9 in 12 algorithms), but not CBF and MTT (r > 0.9 in seven and four algorithms, respectively). In MR, good correlation (r > 0.9) was observed in one-half of commercial programs, while all academic algorithms showed good correlations for all parameters. Most algorithms had delay-dependent errors, especially for commercial software, as well as CBV dependency for CBF or MTT calculation and MTT dependency for CBV calculation. Correlation was good in Tmax except for one algorithm. Conclusion: The digital phantom readily evaluated the accuracy and characteristics of the CT and MR perfusion analysis software. All commercial programs had delay-induced errors and/or insufficient correlations with true values, while academic programs for MR showed good correlations with true values.

Original languageEnglish (US)
Pages (from-to)201-211
Number of pages11
JournalRadiology
Volume267
Issue number1
DOIs
StatePublished - Apr 2013

Fingerprint

Cerebrovascular Circulation
Magnetic Resonance Spectroscopy
Software
Perfusion
Tomography
Perfusion Imaging
Cerebral Blood Volume
Brain

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging

Cite this

Kudo, K., Christensen, S., Sasaki, M., Østergaard, L., Shirato, H., Ogasawara, K., ... Warach, S. (2013). Accuracy and reliability assessment of CT and MR perfusion analysis software using a digital phantom. Radiology, 267(1), 201-211. https://doi.org/10.1148/radiol.12112618

Accuracy and reliability assessment of CT and MR perfusion analysis software using a digital phantom. / Kudo, Kohsuke; Christensen, Soren; Sasaki, Makoto; Østergaard, Leif; Shirato, Hiroki; Ogasawara, Kuniaki; Wintermark, Max; Warach, Steven.

In: Radiology, Vol. 267, No. 1, 04.2013, p. 201-211.

Research output: Contribution to journalArticle

Kudo, K, Christensen, S, Sasaki, M, Østergaard, L, Shirato, H, Ogasawara, K, Wintermark, M & Warach, S 2013, 'Accuracy and reliability assessment of CT and MR perfusion analysis software using a digital phantom', Radiology, vol. 267, no. 1, pp. 201-211. https://doi.org/10.1148/radiol.12112618
Kudo K, Christensen S, Sasaki M, Østergaard L, Shirato H, Ogasawara K et al. Accuracy and reliability assessment of CT and MR perfusion analysis software using a digital phantom. Radiology. 2013 Apr;267(1):201-211. https://doi.org/10.1148/radiol.12112618
Kudo, Kohsuke ; Christensen, Soren ; Sasaki, Makoto ; Østergaard, Leif ; Shirato, Hiroki ; Ogasawara, Kuniaki ; Wintermark, Max ; Warach, Steven. / Accuracy and reliability assessment of CT and MR perfusion analysis software using a digital phantom. In: Radiology. 2013 ; Vol. 267, No. 1. pp. 201-211.
@article{5441b4593ff34ae39965e97777b027c8,
title = "Accuracy and reliability assessment of CT and MR perfusion analysis software using a digital phantom",
abstract = "Purpose: To design a digital phantom data set for computed tomography (CT) perfusion and perfusion-weighted imaging on the basis of the widely accepted tracer kinetic theory in which the true values of cerebral blood flow (CBF), cerebral blood volume (CBV), mean transit time (MTT), and tracer arrival delay are known and to evaluate the accuracy and reliability of postprocessing programs using this digital phantom. Materials and Methods: A phantom data set was created by generating concentration-time curves reflecting true values for CBF (2.5-87.5 mL/100 g per minute), CBV (1.0-5.0 mL/100 g), MTT (3.4-24 seconds), and tracer delays (0-3.0 seconds). These curves were embedded in human brain images. The data were analyzed by using 13 algorithms each for CT and magnetic resonance (MR), including five commercial vendors and five academic programs. Accuracy was assessed by using the Pearson correlation coefficient (r) for true values. Delay-, MTT-, or CBV-dependent errors and correlations between time to maximum of residue function (Tmax) were also evaluated. Results: In CT, CBV was generally well reproduced (r > 0.9 in 12 algorithms), but not CBF and MTT (r > 0.9 in seven and four algorithms, respectively). In MR, good correlation (r > 0.9) was observed in one-half of commercial programs, while all academic algorithms showed good correlations for all parameters. Most algorithms had delay-dependent errors, especially for commercial software, as well as CBV dependency for CBF or MTT calculation and MTT dependency for CBV calculation. Correlation was good in Tmax except for one algorithm. Conclusion: The digital phantom readily evaluated the accuracy and characteristics of the CT and MR perfusion analysis software. All commercial programs had delay-induced errors and/or insufficient correlations with true values, while academic programs for MR showed good correlations with true values.",
author = "Kohsuke Kudo and Soren Christensen and Makoto Sasaki and Leif {\O}stergaard and Hiroki Shirato and Kuniaki Ogasawara and Max Wintermark and Steven Warach",
year = "2013",
month = "4",
doi = "10.1148/radiol.12112618",
language = "English (US)",
volume = "267",
pages = "201--211",
journal = "Radiology",
issn = "0033-8419",
publisher = "Radiological Society of North America Inc.",
number = "1",

}

TY - JOUR

T1 - Accuracy and reliability assessment of CT and MR perfusion analysis software using a digital phantom

AU - Kudo, Kohsuke

AU - Christensen, Soren

AU - Sasaki, Makoto

AU - Østergaard, Leif

AU - Shirato, Hiroki

AU - Ogasawara, Kuniaki

AU - Wintermark, Max

AU - Warach, Steven

PY - 2013/4

Y1 - 2013/4

N2 - Purpose: To design a digital phantom data set for computed tomography (CT) perfusion and perfusion-weighted imaging on the basis of the widely accepted tracer kinetic theory in which the true values of cerebral blood flow (CBF), cerebral blood volume (CBV), mean transit time (MTT), and tracer arrival delay are known and to evaluate the accuracy and reliability of postprocessing programs using this digital phantom. Materials and Methods: A phantom data set was created by generating concentration-time curves reflecting true values for CBF (2.5-87.5 mL/100 g per minute), CBV (1.0-5.0 mL/100 g), MTT (3.4-24 seconds), and tracer delays (0-3.0 seconds). These curves were embedded in human brain images. The data were analyzed by using 13 algorithms each for CT and magnetic resonance (MR), including five commercial vendors and five academic programs. Accuracy was assessed by using the Pearson correlation coefficient (r) for true values. Delay-, MTT-, or CBV-dependent errors and correlations between time to maximum of residue function (Tmax) were also evaluated. Results: In CT, CBV was generally well reproduced (r > 0.9 in 12 algorithms), but not CBF and MTT (r > 0.9 in seven and four algorithms, respectively). In MR, good correlation (r > 0.9) was observed in one-half of commercial programs, while all academic algorithms showed good correlations for all parameters. Most algorithms had delay-dependent errors, especially for commercial software, as well as CBV dependency for CBF or MTT calculation and MTT dependency for CBV calculation. Correlation was good in Tmax except for one algorithm. Conclusion: The digital phantom readily evaluated the accuracy and characteristics of the CT and MR perfusion analysis software. All commercial programs had delay-induced errors and/or insufficient correlations with true values, while academic programs for MR showed good correlations with true values.

AB - Purpose: To design a digital phantom data set for computed tomography (CT) perfusion and perfusion-weighted imaging on the basis of the widely accepted tracer kinetic theory in which the true values of cerebral blood flow (CBF), cerebral blood volume (CBV), mean transit time (MTT), and tracer arrival delay are known and to evaluate the accuracy and reliability of postprocessing programs using this digital phantom. Materials and Methods: A phantom data set was created by generating concentration-time curves reflecting true values for CBF (2.5-87.5 mL/100 g per minute), CBV (1.0-5.0 mL/100 g), MTT (3.4-24 seconds), and tracer delays (0-3.0 seconds). These curves were embedded in human brain images. The data were analyzed by using 13 algorithms each for CT and magnetic resonance (MR), including five commercial vendors and five academic programs. Accuracy was assessed by using the Pearson correlation coefficient (r) for true values. Delay-, MTT-, or CBV-dependent errors and correlations between time to maximum of residue function (Tmax) were also evaluated. Results: In CT, CBV was generally well reproduced (r > 0.9 in 12 algorithms), but not CBF and MTT (r > 0.9 in seven and four algorithms, respectively). In MR, good correlation (r > 0.9) was observed in one-half of commercial programs, while all academic algorithms showed good correlations for all parameters. Most algorithms had delay-dependent errors, especially for commercial software, as well as CBV dependency for CBF or MTT calculation and MTT dependency for CBV calculation. Correlation was good in Tmax except for one algorithm. Conclusion: The digital phantom readily evaluated the accuracy and characteristics of the CT and MR perfusion analysis software. All commercial programs had delay-induced errors and/or insufficient correlations with true values, while academic programs for MR showed good correlations with true values.

UR - http://www.scopus.com/inward/record.url?scp=84875473343&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84875473343&partnerID=8YFLogxK

U2 - 10.1148/radiol.12112618

DO - 10.1148/radiol.12112618

M3 - Article

VL - 267

SP - 201

EP - 211

JO - Radiology

JF - Radiology

SN - 0033-8419

IS - 1

ER -