Unsupervised super-resolution reconstruction of hyperspectral histology images for whole-slide imaging

Ling Ma, Armand Rathgeb, Hasan Mubarak, Minh Tran, Baowei Fei

Research output: Contribution to journalArticlepeer-review

Abstract

Significance: Hyperspectral imaging (HSI) provides rich spectral information for improved histopathological cancer detection. However, acquiring high-resolution HSI data for whole-slide imaging (WSI) can be time-consuming and requires a huge amount of storage space. Aim: WSI using a color camera can be achieved with fast speed, high image resolution, and excellent image quality due to the established techniques. We aim to develop an RGB-guided unsupervised hyperspectral super-resolution reconstruction method that is hypothesized to improve image quality while maintaining the spectral characteristics. Approach: High-resolution hyperspectral images of 32 histologic slides were obtained via automated WSI. High-resolution RGB histology images were registered to the hyperspectral images for RGB guidance. An unsupervised super-resolution network was trained to take the downsampled low-resolution hyperspectral patches (LR-HSI) and high-resolution RGB patches (HR-RGB) as inputs to reconstruct high-resolution hyperspectral patches (HR-HSI). Then, an Inception-based network was trained with the HR-RGB, original HR-HSI, and generated HR-HSI, respectively, for whole-slide histopathological cancer detection. Results: Our super-resolution reconstruction network generated high-resolution hyperspectral images with well-maintained spectral characteristics and improved image quality. Image classification using the original hyperspectral data outperformed RGB because of the extra spectral information. The generated hyperspectral image patches further improved the results. Conclusions: The proposed method potentially reduces image acquisition time, saves storage space without compromising image quality, and improves the image classification performance.

Original languageEnglish (US)
Article number056502
JournalJournal of biomedical optics
Volume27
Issue number5
DOIs
StatePublished - May 1 2022
Externally publishedYes

Keywords

  • hyperspectral imaging
  • image classification
  • RGB guidance
  • super-resolution reconstruction
  • unsupervised

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics
  • Biomaterials
  • Biomedical Engineering

Fingerprint

Dive into the research topics of 'Unsupervised super-resolution reconstruction of hyperspectral histology images for whole-slide imaging'. Together they form a unique fingerprint.

Cite this