Super-resolution stereo light microscopy for real-time tasks using normal flow and geometric constraints

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

Prior knowledge about the observed scene represents the key to recovering frequencies beyond the passband of an imaging system (super-resolution). With regard to microscopy mainly two super-resolution mechanisms have been reported: 1.) analytic continuation of the frequency spectrum and 2.) constrained image deconvolution. This paper describes an alternative super-resolution mechanism. Prior knowledge is introduced on a higher, more symbolic level of visual inference. We exemplify our concept based on the 3D reconstruction of a micro-pipette moving in close proximity to immobile target objects. Information about the shape and the mobility of the pipette is incorporated in order to localize the pipette tip at sub-Rayleigh distances to the target. The algorithm was tested in a micro-robot environment. A machine vision module using stereo light microscopy automatically controlled the manipulation of microscopic objects, e.g. latex beads or diamond mono-crystals. In the theoretical part of the paper we prove that knowledge of the form `the pipette has moved between two consecutive frames of the movie' must result in a twofold increase of resolution. We used the normal flow of an image to decode positional measures from motion. In practice, super-resolution factors between 3 to 5 were obtained. The additional gain originates from the geometric constraints which were included to reconstruct the pipette position.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
PublisherSociety of Photo-Optical Instrumentation Engineers
Pages129-140
Number of pages12
Volume3919
StatePublished - 2000
EventThree-Dimensional and Multidimensional Microscopy: Image Acquisition Processing VII - San Jose, CA, USA
Duration: Jan 23 2000Jan 24 2000

Other

OtherThree-Dimensional and Multidimensional Microscopy: Image Acquisition Processing VII
CitySan Jose, CA, USA
Period1/23/001/24/00

Fingerprint

pipettes
Deconvolution
Latexes
Imaging systems
Computer vision
Optical microscopy
Diamonds
Microscopic examination
Robots
microscopy
Crystals
computer vision
latex
robots
inference
beads
proximity
manipulators
modules
diamonds

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Condensed Matter Physics

Cite this

Danuser, G. (2000). Super-resolution stereo light microscopy for real-time tasks using normal flow and geometric constraints. In Proceedings of SPIE - The International Society for Optical Engineering (Vol. 3919, pp. 129-140). Society of Photo-Optical Instrumentation Engineers.

Super-resolution stereo light microscopy for real-time tasks using normal flow and geometric constraints. / Danuser, Gaudenz.

Proceedings of SPIE - The International Society for Optical Engineering. Vol. 3919 Society of Photo-Optical Instrumentation Engineers, 2000. p. 129-140.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Danuser, G 2000, Super-resolution stereo light microscopy for real-time tasks using normal flow and geometric constraints. in Proceedings of SPIE - The International Society for Optical Engineering. vol. 3919, Society of Photo-Optical Instrumentation Engineers, pp. 129-140, Three-Dimensional and Multidimensional Microscopy: Image Acquisition Processing VII, San Jose, CA, USA, 1/23/00.
Danuser G. Super-resolution stereo light microscopy for real-time tasks using normal flow and geometric constraints. In Proceedings of SPIE - The International Society for Optical Engineering. Vol. 3919. Society of Photo-Optical Instrumentation Engineers. 2000. p. 129-140
Danuser, Gaudenz. / Super-resolution stereo light microscopy for real-time tasks using normal flow and geometric constraints. Proceedings of SPIE - The International Society for Optical Engineering. Vol. 3919 Society of Photo-Optical Instrumentation Engineers, 2000. pp. 129-140
@inproceedings{fcff6439ae7f434296e0228c8a9df2f6,
title = "Super-resolution stereo light microscopy for real-time tasks using normal flow and geometric constraints",
abstract = "Prior knowledge about the observed scene represents the key to recovering frequencies beyond the passband of an imaging system (super-resolution). With regard to microscopy mainly two super-resolution mechanisms have been reported: 1.) analytic continuation of the frequency spectrum and 2.) constrained image deconvolution. This paper describes an alternative super-resolution mechanism. Prior knowledge is introduced on a higher, more symbolic level of visual inference. We exemplify our concept based on the 3D reconstruction of a micro-pipette moving in close proximity to immobile target objects. Information about the shape and the mobility of the pipette is incorporated in order to localize the pipette tip at sub-Rayleigh distances to the target. The algorithm was tested in a micro-robot environment. A machine vision module using stereo light microscopy automatically controlled the manipulation of microscopic objects, e.g. latex beads or diamond mono-crystals. In the theoretical part of the paper we prove that knowledge of the form `the pipette has moved between two consecutive frames of the movie' must result in a twofold increase of resolution. We used the normal flow of an image to decode positional measures from motion. In practice, super-resolution factors between 3 to 5 were obtained. The additional gain originates from the geometric constraints which were included to reconstruct the pipette position.",
author = "Gaudenz Danuser",
year = "2000",
language = "English (US)",
volume = "3919",
pages = "129--140",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",
publisher = "Society of Photo-Optical Instrumentation Engineers",

}

TY - GEN

T1 - Super-resolution stereo light microscopy for real-time tasks using normal flow and geometric constraints

AU - Danuser, Gaudenz

PY - 2000

Y1 - 2000

N2 - Prior knowledge about the observed scene represents the key to recovering frequencies beyond the passband of an imaging system (super-resolution). With regard to microscopy mainly two super-resolution mechanisms have been reported: 1.) analytic continuation of the frequency spectrum and 2.) constrained image deconvolution. This paper describes an alternative super-resolution mechanism. Prior knowledge is introduced on a higher, more symbolic level of visual inference. We exemplify our concept based on the 3D reconstruction of a micro-pipette moving in close proximity to immobile target objects. Information about the shape and the mobility of the pipette is incorporated in order to localize the pipette tip at sub-Rayleigh distances to the target. The algorithm was tested in a micro-robot environment. A machine vision module using stereo light microscopy automatically controlled the manipulation of microscopic objects, e.g. latex beads or diamond mono-crystals. In the theoretical part of the paper we prove that knowledge of the form `the pipette has moved between two consecutive frames of the movie' must result in a twofold increase of resolution. We used the normal flow of an image to decode positional measures from motion. In practice, super-resolution factors between 3 to 5 were obtained. The additional gain originates from the geometric constraints which were included to reconstruct the pipette position.

AB - Prior knowledge about the observed scene represents the key to recovering frequencies beyond the passband of an imaging system (super-resolution). With regard to microscopy mainly two super-resolution mechanisms have been reported: 1.) analytic continuation of the frequency spectrum and 2.) constrained image deconvolution. This paper describes an alternative super-resolution mechanism. Prior knowledge is introduced on a higher, more symbolic level of visual inference. We exemplify our concept based on the 3D reconstruction of a micro-pipette moving in close proximity to immobile target objects. Information about the shape and the mobility of the pipette is incorporated in order to localize the pipette tip at sub-Rayleigh distances to the target. The algorithm was tested in a micro-robot environment. A machine vision module using stereo light microscopy automatically controlled the manipulation of microscopic objects, e.g. latex beads or diamond mono-crystals. In the theoretical part of the paper we prove that knowledge of the form `the pipette has moved between two consecutive frames of the movie' must result in a twofold increase of resolution. We used the normal flow of an image to decode positional measures from motion. In practice, super-resolution factors between 3 to 5 were obtained. The additional gain originates from the geometric constraints which were included to reconstruct the pipette position.

UR - http://www.scopus.com/inward/record.url?scp=0033703136&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0033703136&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:0033703136

VL - 3919

SP - 129

EP - 140

BT - Proceedings of SPIE - The International Society for Optical Engineering

PB - Society of Photo-Optical Instrumentation Engineers

ER -