Objective assessment of deformable image registration in radiotherapy: A multi-institution study

Rojano Kashani, Martina Hub, James M. Balter, Marc L. Kessler, Lei Dong, Lifei Zhang, Lei Xing, Yaoqin Xie, David Hawkes, Julia A. Schnabel, Jamie McClelland, Sarang Joshi, Quan Chen, Weiguo Lu

Research output: Contribution to journalArticle

110 Citations (Scopus)

Abstract

The looming potential of deformable alignment tools to play an integral role in adaptive radiotherapy suggests a need for objective assessment of these complex algorithms. Previous studies in this area are based on the ability of alignment to reproduce analytically generated deformations applied to sample image data, or use of contours or bifurcations as ground truth for evaluation of alignment accuracy. In this study, a deformable phantom was embedded with 48 small plastic markers, placed in regions varying from high contrast to roughly uniform regional intensity, and small to large regional discontinuities in movement. CT volumes of this phantom were acquired at different deformation states. After manual localization of marker coordinates, images were edited to remove the markers. The resulting image volumes were sent to five collaborating institutions, each of which has developed previously published deformable alignment tools routinely in use. Alignments were done, and applied to the list of reference coordinates at the inhale state. The transformed coordinates were compared to the actual marker locations at exhale. A total of eight alignment techniques were tested from the six institutions. All algorithms performed generally well, as compared to previous publications. Average errors in predicted location ranged from 1.5 to 3.9 mm, depending on technique. No algorithm was uniformly accurate across all regions of the phantom, with maximum errors ranging from 5.1 to 15.4 mm. Larger errors were seen in regions near significant shape changes, as well as areas with uniform contrast but large local motion discontinuity. Although reasonable accuracy was achieved overall, the variation of error in different regions suggests caution in globally accepting the results from deformable alignment.

Original languageEnglish (US)
Pages (from-to)5944-5953
Number of pages10
JournalMedical Physics
Volume35
Issue number12
DOIs
StatePublished - 2008

Fingerprint

Radiotherapy
Cone-Beam Computed Tomography
Needs Assessment
Plastics

Keywords

  • Deformable alignment
  • Image registration
  • Validation

ASJC Scopus subject areas

  • Biophysics
  • Radiology Nuclear Medicine and imaging

Cite this

Kashani, R., Hub, M., Balter, J. M., Kessler, M. L., Dong, L., Zhang, L., ... Lu, W. (2008). Objective assessment of deformable image registration in radiotherapy: A multi-institution study. Medical Physics, 35(12), 5944-5953. https://doi.org/10.1118/1.3013563

Objective assessment of deformable image registration in radiotherapy : A multi-institution study. / Kashani, Rojano; Hub, Martina; Balter, James M.; Kessler, Marc L.; Dong, Lei; Zhang, Lifei; Xing, Lei; Xie, Yaoqin; Hawkes, David; Schnabel, Julia A.; McClelland, Jamie; Joshi, Sarang; Chen, Quan; Lu, Weiguo.

In: Medical Physics, Vol. 35, No. 12, 2008, p. 5944-5953.

Research output: Contribution to journalArticle

Kashani, R, Hub, M, Balter, JM, Kessler, ML, Dong, L, Zhang, L, Xing, L, Xie, Y, Hawkes, D, Schnabel, JA, McClelland, J, Joshi, S, Chen, Q & Lu, W 2008, 'Objective assessment of deformable image registration in radiotherapy: A multi-institution study', Medical Physics, vol. 35, no. 12, pp. 5944-5953. https://doi.org/10.1118/1.3013563
Kashani, Rojano ; Hub, Martina ; Balter, James M. ; Kessler, Marc L. ; Dong, Lei ; Zhang, Lifei ; Xing, Lei ; Xie, Yaoqin ; Hawkes, David ; Schnabel, Julia A. ; McClelland, Jamie ; Joshi, Sarang ; Chen, Quan ; Lu, Weiguo. / Objective assessment of deformable image registration in radiotherapy : A multi-institution study. In: Medical Physics. 2008 ; Vol. 35, No. 12. pp. 5944-5953.
@article{252627528fcd41e8aa0e87b8f7773745,
title = "Objective assessment of deformable image registration in radiotherapy: A multi-institution study",
abstract = "The looming potential of deformable alignment tools to play an integral role in adaptive radiotherapy suggests a need for objective assessment of these complex algorithms. Previous studies in this area are based on the ability of alignment to reproduce analytically generated deformations applied to sample image data, or use of contours or bifurcations as ground truth for evaluation of alignment accuracy. In this study, a deformable phantom was embedded with 48 small plastic markers, placed in regions varying from high contrast to roughly uniform regional intensity, and small to large regional discontinuities in movement. CT volumes of this phantom were acquired at different deformation states. After manual localization of marker coordinates, images were edited to remove the markers. The resulting image volumes were sent to five collaborating institutions, each of which has developed previously published deformable alignment tools routinely in use. Alignments were done, and applied to the list of reference coordinates at the inhale state. The transformed coordinates were compared to the actual marker locations at exhale. A total of eight alignment techniques were tested from the six institutions. All algorithms performed generally well, as compared to previous publications. Average errors in predicted location ranged from 1.5 to 3.9 mm, depending on technique. No algorithm was uniformly accurate across all regions of the phantom, with maximum errors ranging from 5.1 to 15.4 mm. Larger errors were seen in regions near significant shape changes, as well as areas with uniform contrast but large local motion discontinuity. Although reasonable accuracy was achieved overall, the variation of error in different regions suggests caution in globally accepting the results from deformable alignment.",
keywords = "Deformable alignment, Image registration, Validation",
author = "Rojano Kashani and Martina Hub and Balter, {James M.} and Kessler, {Marc L.} and Lei Dong and Lifei Zhang and Lei Xing and Yaoqin Xie and David Hawkes and Schnabel, {Julia A.} and Jamie McClelland and Sarang Joshi and Quan Chen and Weiguo Lu",
year = "2008",
doi = "10.1118/1.3013563",
language = "English (US)",
volume = "35",
pages = "5944--5953",
journal = "Medical Physics",
issn = "0094-2405",
publisher = "AAPM - American Association of Physicists in Medicine",
number = "12",

}

TY - JOUR

T1 - Objective assessment of deformable image registration in radiotherapy

T2 - A multi-institution study

AU - Kashani, Rojano

AU - Hub, Martina

AU - Balter, James M.

AU - Kessler, Marc L.

AU - Dong, Lei

AU - Zhang, Lifei

AU - Xing, Lei

AU - Xie, Yaoqin

AU - Hawkes, David

AU - Schnabel, Julia A.

AU - McClelland, Jamie

AU - Joshi, Sarang

AU - Chen, Quan

AU - Lu, Weiguo

PY - 2008

Y1 - 2008

N2 - The looming potential of deformable alignment tools to play an integral role in adaptive radiotherapy suggests a need for objective assessment of these complex algorithms. Previous studies in this area are based on the ability of alignment to reproduce analytically generated deformations applied to sample image data, or use of contours or bifurcations as ground truth for evaluation of alignment accuracy. In this study, a deformable phantom was embedded with 48 small plastic markers, placed in regions varying from high contrast to roughly uniform regional intensity, and small to large regional discontinuities in movement. CT volumes of this phantom were acquired at different deformation states. After manual localization of marker coordinates, images were edited to remove the markers. The resulting image volumes were sent to five collaborating institutions, each of which has developed previously published deformable alignment tools routinely in use. Alignments were done, and applied to the list of reference coordinates at the inhale state. The transformed coordinates were compared to the actual marker locations at exhale. A total of eight alignment techniques were tested from the six institutions. All algorithms performed generally well, as compared to previous publications. Average errors in predicted location ranged from 1.5 to 3.9 mm, depending on technique. No algorithm was uniformly accurate across all regions of the phantom, with maximum errors ranging from 5.1 to 15.4 mm. Larger errors were seen in regions near significant shape changes, as well as areas with uniform contrast but large local motion discontinuity. Although reasonable accuracy was achieved overall, the variation of error in different regions suggests caution in globally accepting the results from deformable alignment.

AB - The looming potential of deformable alignment tools to play an integral role in adaptive radiotherapy suggests a need for objective assessment of these complex algorithms. Previous studies in this area are based on the ability of alignment to reproduce analytically generated deformations applied to sample image data, or use of contours or bifurcations as ground truth for evaluation of alignment accuracy. In this study, a deformable phantom was embedded with 48 small plastic markers, placed in regions varying from high contrast to roughly uniform regional intensity, and small to large regional discontinuities in movement. CT volumes of this phantom were acquired at different deformation states. After manual localization of marker coordinates, images were edited to remove the markers. The resulting image volumes were sent to five collaborating institutions, each of which has developed previously published deformable alignment tools routinely in use. Alignments were done, and applied to the list of reference coordinates at the inhale state. The transformed coordinates were compared to the actual marker locations at exhale. A total of eight alignment techniques were tested from the six institutions. All algorithms performed generally well, as compared to previous publications. Average errors in predicted location ranged from 1.5 to 3.9 mm, depending on technique. No algorithm was uniformly accurate across all regions of the phantom, with maximum errors ranging from 5.1 to 15.4 mm. Larger errors were seen in regions near significant shape changes, as well as areas with uniform contrast but large local motion discontinuity. Although reasonable accuracy was achieved overall, the variation of error in different regions suggests caution in globally accepting the results from deformable alignment.

KW - Deformable alignment

KW - Image registration

KW - Validation

UR - http://www.scopus.com/inward/record.url?scp=56749158943&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=56749158943&partnerID=8YFLogxK

U2 - 10.1118/1.3013563

DO - 10.1118/1.3013563

M3 - Article

C2 - 19175149

AN - SCOPUS:56749158943

VL - 35

SP - 5944

EP - 5953

JO - Medical Physics

JF - Medical Physics

SN - 0094-2405

IS - 12

ER -