Elastic registration of multimodal prostate MRI and histology via multiattribute combined mutual information

Jonathan Chappelow, B. Nicolas Bloch, Neil Rofsky, Elizabeth Genega, Robert Lenkinski, William Dewolf, Anant Madabhushi

Research output: Contribution to journalArticle

76 Citations (Scopus)

Abstract

Purpose: By performing registration of preoperative multiprotocol in vivo magnetic resonance (MR) images of the prostate with corresponding whole-mount histology (WMH) sections from postoperative radical prostatectomy specimens, an accurate estimate of the spatial extent of prostate cancer (CaP) on in vivo MR imaging (MRI) can be retrospectively established. This could allow for definition of quantitative image-based disease signatures and lead to development of classifiers for disease detection on multiprotocol in vivo MRI. Automated registration of MR and WMH images of the prostate is complicated by dissimilar image intensities, acquisition artifacts, and nonlinear shape differences. Methods: The authors present a method for automated elastic registration of multiprotocol in vivo MRI and WMH sections of the prostate. The method, multiattribute combined mutual information (MACMI), leverages all available multiprotocol image data to drive image registration using a multivariate formulation of mutual information. Results: Elastic registration using the multivariate MI formulation is demonstrated for 150 corresponding sets of prostate images from 25 patient studies with T2-weighted and dynamic-contrast enhanced MRI and 85 image sets from 15 studies with an additional functional apparent diffusion coefficient MRI series. Qualitative results of MACMI evaluation via visual inspection suggest that an accurate delineation of CaP extent on MRI is obtained. Results of quantitative evaluation on 150 clinical and 20 synthetic image sets indicate improved registration accuracy using MACMI compared to conventional pairwise mutual information-based approaches. Conclusions: The authors' approach to the registration of in vivo multiprotocol MRI and ex vivo WMH of the prostate using MACMI is unique, in that (1) information from all available image protocols is utilized to drive the registration with histology, (2) no additional, intermediate ex vivo radiology or gross histology images need be obtained in addition to the routinely acquired in vivo MRI series, and (3) no corresponding anatomical landmarks are required to be identified manually or automatically on the images.

Original languageEnglish (US)
Pages (from-to)2005-2018
Number of pages14
JournalMedical Physics
Volume38
Issue number4
DOIs
StatePublished - Apr 2011

Fingerprint

Prostate
Histology
Magnetic Resonance Spectroscopy
Prostatectomy
Radiology
Artifacts
Prostatic Neoplasms
Magnetic Resonance Imaging

Keywords

  • elastic registration
  • histology
  • in vivo
  • MACMI
  • magnetic resonance
  • mutual information
  • prostate cancer

ASJC Scopus subject areas

  • Biophysics
  • Radiology Nuclear Medicine and imaging

Cite this

Chappelow, J., Bloch, B. N., Rofsky, N., Genega, E., Lenkinski, R., Dewolf, W., & Madabhushi, A. (2011). Elastic registration of multimodal prostate MRI and histology via multiattribute combined mutual information. Medical Physics, 38(4), 2005-2018. https://doi.org/10.1118/1.3560879

Elastic registration of multimodal prostate MRI and histology via multiattribute combined mutual information. / Chappelow, Jonathan; Bloch, B. Nicolas; Rofsky, Neil; Genega, Elizabeth; Lenkinski, Robert; Dewolf, William; Madabhushi, Anant.

In: Medical Physics, Vol. 38, No. 4, 04.2011, p. 2005-2018.

Research output: Contribution to journalArticle

Chappelow, J, Bloch, BN, Rofsky, N, Genega, E, Lenkinski, R, Dewolf, W & Madabhushi, A 2011, 'Elastic registration of multimodal prostate MRI and histology via multiattribute combined mutual information', Medical Physics, vol. 38, no. 4, pp. 2005-2018. https://doi.org/10.1118/1.3560879
Chappelow, Jonathan ; Bloch, B. Nicolas ; Rofsky, Neil ; Genega, Elizabeth ; Lenkinski, Robert ; Dewolf, William ; Madabhushi, Anant. / Elastic registration of multimodal prostate MRI and histology via multiattribute combined mutual information. In: Medical Physics. 2011 ; Vol. 38, No. 4. pp. 2005-2018.
@article{fcad4b536f384e6fb9d961d2e90f042f,
title = "Elastic registration of multimodal prostate MRI and histology via multiattribute combined mutual information",
abstract = "Purpose: By performing registration of preoperative multiprotocol in vivo magnetic resonance (MR) images of the prostate with corresponding whole-mount histology (WMH) sections from postoperative radical prostatectomy specimens, an accurate estimate of the spatial extent of prostate cancer (CaP) on in vivo MR imaging (MRI) can be retrospectively established. This could allow for definition of quantitative image-based disease signatures and lead to development of classifiers for disease detection on multiprotocol in vivo MRI. Automated registration of MR and WMH images of the prostate is complicated by dissimilar image intensities, acquisition artifacts, and nonlinear shape differences. Methods: The authors present a method for automated elastic registration of multiprotocol in vivo MRI and WMH sections of the prostate. The method, multiattribute combined mutual information (MACMI), leverages all available multiprotocol image data to drive image registration using a multivariate formulation of mutual information. Results: Elastic registration using the multivariate MI formulation is demonstrated for 150 corresponding sets of prostate images from 25 patient studies with T2-weighted and dynamic-contrast enhanced MRI and 85 image sets from 15 studies with an additional functional apparent diffusion coefficient MRI series. Qualitative results of MACMI evaluation via visual inspection suggest that an accurate delineation of CaP extent on MRI is obtained. Results of quantitative evaluation on 150 clinical and 20 synthetic image sets indicate improved registration accuracy using MACMI compared to conventional pairwise mutual information-based approaches. Conclusions: The authors' approach to the registration of in vivo multiprotocol MRI and ex vivo WMH of the prostate using MACMI is unique, in that (1) information from all available image protocols is utilized to drive the registration with histology, (2) no additional, intermediate ex vivo radiology or gross histology images need be obtained in addition to the routinely acquired in vivo MRI series, and (3) no corresponding anatomical landmarks are required to be identified manually or automatically on the images.",
keywords = "elastic registration, histology, in vivo, MACMI, magnetic resonance, mutual information, prostate cancer",
author = "Jonathan Chappelow and Bloch, {B. Nicolas} and Neil Rofsky and Elizabeth Genega and Robert Lenkinski and William Dewolf and Anant Madabhushi",
year = "2011",
month = "4",
doi = "10.1118/1.3560879",
language = "English (US)",
volume = "38",
pages = "2005--2018",
journal = "Medical Physics",
issn = "0094-2405",
publisher = "AAPM - American Association of Physicists in Medicine",
number = "4",

}

TY - JOUR

T1 - Elastic registration of multimodal prostate MRI and histology via multiattribute combined mutual information

AU - Chappelow, Jonathan

AU - Bloch, B. Nicolas

AU - Rofsky, Neil

AU - Genega, Elizabeth

AU - Lenkinski, Robert

AU - Dewolf, William

AU - Madabhushi, Anant

PY - 2011/4

Y1 - 2011/4

N2 - Purpose: By performing registration of preoperative multiprotocol in vivo magnetic resonance (MR) images of the prostate with corresponding whole-mount histology (WMH) sections from postoperative radical prostatectomy specimens, an accurate estimate of the spatial extent of prostate cancer (CaP) on in vivo MR imaging (MRI) can be retrospectively established. This could allow for definition of quantitative image-based disease signatures and lead to development of classifiers for disease detection on multiprotocol in vivo MRI. Automated registration of MR and WMH images of the prostate is complicated by dissimilar image intensities, acquisition artifacts, and nonlinear shape differences. Methods: The authors present a method for automated elastic registration of multiprotocol in vivo MRI and WMH sections of the prostate. The method, multiattribute combined mutual information (MACMI), leverages all available multiprotocol image data to drive image registration using a multivariate formulation of mutual information. Results: Elastic registration using the multivariate MI formulation is demonstrated for 150 corresponding sets of prostate images from 25 patient studies with T2-weighted and dynamic-contrast enhanced MRI and 85 image sets from 15 studies with an additional functional apparent diffusion coefficient MRI series. Qualitative results of MACMI evaluation via visual inspection suggest that an accurate delineation of CaP extent on MRI is obtained. Results of quantitative evaluation on 150 clinical and 20 synthetic image sets indicate improved registration accuracy using MACMI compared to conventional pairwise mutual information-based approaches. Conclusions: The authors' approach to the registration of in vivo multiprotocol MRI and ex vivo WMH of the prostate using MACMI is unique, in that (1) information from all available image protocols is utilized to drive the registration with histology, (2) no additional, intermediate ex vivo radiology or gross histology images need be obtained in addition to the routinely acquired in vivo MRI series, and (3) no corresponding anatomical landmarks are required to be identified manually or automatically on the images.

AB - Purpose: By performing registration of preoperative multiprotocol in vivo magnetic resonance (MR) images of the prostate with corresponding whole-mount histology (WMH) sections from postoperative radical prostatectomy specimens, an accurate estimate of the spatial extent of prostate cancer (CaP) on in vivo MR imaging (MRI) can be retrospectively established. This could allow for definition of quantitative image-based disease signatures and lead to development of classifiers for disease detection on multiprotocol in vivo MRI. Automated registration of MR and WMH images of the prostate is complicated by dissimilar image intensities, acquisition artifacts, and nonlinear shape differences. Methods: The authors present a method for automated elastic registration of multiprotocol in vivo MRI and WMH sections of the prostate. The method, multiattribute combined mutual information (MACMI), leverages all available multiprotocol image data to drive image registration using a multivariate formulation of mutual information. Results: Elastic registration using the multivariate MI formulation is demonstrated for 150 corresponding sets of prostate images from 25 patient studies with T2-weighted and dynamic-contrast enhanced MRI and 85 image sets from 15 studies with an additional functional apparent diffusion coefficient MRI series. Qualitative results of MACMI evaluation via visual inspection suggest that an accurate delineation of CaP extent on MRI is obtained. Results of quantitative evaluation on 150 clinical and 20 synthetic image sets indicate improved registration accuracy using MACMI compared to conventional pairwise mutual information-based approaches. Conclusions: The authors' approach to the registration of in vivo multiprotocol MRI and ex vivo WMH of the prostate using MACMI is unique, in that (1) information from all available image protocols is utilized to drive the registration with histology, (2) no additional, intermediate ex vivo radiology or gross histology images need be obtained in addition to the routinely acquired in vivo MRI series, and (3) no corresponding anatomical landmarks are required to be identified manually or automatically on the images.

KW - elastic registration

KW - histology

KW - in vivo

KW - MACMI

KW - magnetic resonance

KW - mutual information

KW - prostate cancer

UR - http://www.scopus.com/inward/record.url?scp=79953658884&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79953658884&partnerID=8YFLogxK

U2 - 10.1118/1.3560879

DO - 10.1118/1.3560879

M3 - Article

C2 - 21626933

AN - SCOPUS:79953658884

VL - 38

SP - 2005

EP - 2018

JO - Medical Physics

JF - Medical Physics

SN - 0094-2405

IS - 4

ER -