Deep learning in spatiotemporal filtering for super-resolution ultrasound imaging

Katherine Brown, Kenneth Hoyt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Super-resolution ultrasound (SR-US) imaging shows great promise as a clinical technique that can improve ultrasound (US) resolution by an order of magnitude. Current algorithms for SR-US suffer from high complexity and long computation times, precluding real-time imaging. Neural networks can be viewed as general function approximators and can process images at frame rates suitable for a real-time application. The goal of this study was to evaluate the effectiveness of deep networks to learn algorithms for tissue signal suppression while improving performance of SR-US for visualization of microvascular networks. In this study, deep 3D convolutional neural networks (3DCNNs) were chosen to perform spatiotemporal filtering to suppress the tissue signal and perform microbubble (MB) segmentation in place of conventional signal processing methods, e.g. singular value decomposition (SVD), singular value filtering (SVF), or difference filtering (DIF). For each method, a 3DCNN was trained with the respective conventional signal processing algorithm as ground truth. Three 3DCNN architectures with 6 to 7 layers and an input size of 9 x 9 x 9 pixels were evaluated. In vivo data was collected from a cancer-bearing murine model and images were captured with a clinical US scanner equipped with a 15L8 linear array transducer. In vivo data were used to train the networks and testing was based on an in vivo dataset not used in training. The deep networks reached testing accuracies of 97.1% for the DIF implementation with promising performance improvements. The average processing frame rate for in vivo images was 50 Hz with graphical processing unit (GPU) acceleration. Deep learning shows potential for effective spatiotemporal filtering, improving performance of SRUS towards a real-time imaging modality.

Original languageEnglish (US)
Title of host publication2019 IEEE International Ultrasonics Symposium, IUS 2019
PublisherIEEE Computer Society
Pages1114-1117
Number of pages4
ISBN (Electronic)9781728145969
DOIs
StatePublished - Oct 2019
Externally publishedYes
Event2019 IEEE International Ultrasonics Symposium, IUS 2019 - Glasgow, United Kingdom
Duration: Oct 6 2019Oct 9 2019

Publication series

NameIEEE International Ultrasonics Symposium, IUS
Volume2019-October
ISSN (Print)1948-5719
ISSN (Electronic)1948-5727

Conference

Conference2019 IEEE International Ultrasonics Symposium, IUS 2019
CountryUnited Kingdom
CityGlasgow
Period10/6/1910/9/19

Keywords

  • contrast agents
  • contrast-enhanced ultrasound
  • deep learning
  • microbubbles
  • super-resolution ultrasound

ASJC Scopus subject areas

  • Acoustics and Ultrasonics

Fingerprint Dive into the research topics of 'Deep learning in spatiotemporal filtering for super-resolution ultrasound imaging'. Together they form a unique fingerprint.

  • Cite this

    Brown, K., & Hoyt, K. (2019). Deep learning in spatiotemporal filtering for super-resolution ultrasound imaging. In 2019 IEEE International Ultrasonics Symposium, IUS 2019 (pp. 1114-1117). [8926282] (IEEE International Ultrasonics Symposium, IUS; Vol. 2019-October). IEEE Computer Society. https://doi.org/10.1109/ULTSYM.2019.8926282