Band selection for oxygenation estimation with multispectral/hyperspectral imaging

Leonardo Ayala, Fabian Isensee, Sebastian J. Wirkert, Anant S. Vemuri, Klaus H. Maier-Hein, Baowei Fei, Lena Maier-Hein

Research output: Contribution to journalArticlepeer-review

Abstract

Multispectral imaging provides valuable information on tissue composition such as hemoglobin oxygen saturation. However, the real-time application of this technique in interventional medicine can be challenging due to the long acquisition times needed for large amounts of hyperspectral data with hundreds of bands. While this challenge can partially be addressed by choosing a discriminative subset of bands, the band selection methods proposed to date are mainly restricted by the availability of often hard to obtain reference measurements. We address this bottleneck with a new approach to band selection that leverages highly accurate Monte Carlo (MC) simulations. We hypothesize that a so chosen small subset of bands can reproduce or even improve upon the results of a quasi continuous spectral measurement. We further investigate whether novel domain adaptation techniques can address the inevitable domain shift stemming from the use of simulations. Initial results based on in silico and in vivo experiments suggest that 10-20 bands are sufficient to closely reproduce results from spectral measurements with 101 bands in the 500-700 nm range. The investigated domain adaptation technique, which only requires unlabeled in vivo measurements, yielded better results than the pure in silico band selection method. Overall, our method could guide development of fast multispectral imaging systems suited for interventional use without relying on complex hardware setups or manually labeled data.

Original languageEnglish (US)
Pages (from-to)1224-1242
Number of pages19
JournalBiomedical Optics Express
Volume13
Issue number3
DOIs
StatePublished - Mar 1 2022

ASJC Scopus subject areas

  • Biotechnology
  • Atomic and Molecular Physics, and Optics

Fingerprint

Dive into the research topics of 'Band selection for oxygenation estimation with multispectral/hyperspectral imaging'. Together they form a unique fingerprint.

Cite this