Fluoroscopic tracking of multiple implanted fiducial markers using multiple object tracking

Xiaoli Tang, Greg C. Sharp, Steve B. Jiang

Research output: Contribution to journalArticle

65 Citations (Scopus)

Abstract

When treating mobile tumors using techniques such as beam gating or beam tracking, precise localization of tumor position is required, which is often realized by fluoroscopically tracking implanted fiducial markers. Multiple markers placed inside or near a tumor are often preferred to a single marker for the sake of accuracy. In this work, we propose a marker tracking system that can track multiple markers simultaneously, without confusing them, and that is also robust enough to continue tracking even when the markers are moving behind bony anatomy. The integrated radiotherapy imaging system (IRIS), developed at the Massachusetts General Hospital (MGH), was used to take fluoroscopy videos for marker tracking. The tracking system integrates marker detection with a multiple object tracking process, inspired by the multiple hypothesis marker tracking (MHT) process. It also utilizes breathing pattern information to help tracking. Four criteria are used to identify tracking failure, and when tracking failure occurs, the system can immediately inform the user. (In the clinical environment, the system would immediately disable the treatment beam.) In this paper, two liver patients with implanted fiducial markers were studied, and the studies were performed retrospectively to assess the effectiveness of the new tracking system. For both patients, LAT and AP fluoroscopic videos were studied. In order to better test the proposed tracking system, artificial markers were added around the real markers to disturb the tracking of the real markers. The performance of the proposed system was compared to that of a conventional tracking system (one that did not use multiple object tracking). The performance of the new system was also investigated with and without consideration of the breathing pattern information. We found that the conventional tracking system can easily miss tracking markers in the presence of artificial markers, and it cannot detect the tracking failures. On the other hand, our proposed system can track markers well and can also successfully detect tracking failures. Failure rate was calculated on a per-frame-per-marker basis for the proposed tracking system. When the system considered breathing pattern information, it had a 0% failure rate 75% of the time and 0.4% failure rate 25% of the time. However, when the system did not consider breathing patterns, it had a much higher failure rate, in the range of 1.2%-12%. Both examples of the proposed system yielded low e95 (the maximum marker tracking error at 95% confidence level) - less than 1.5 mm.

Original languageEnglish (US)
Article number005
Pages (from-to)4081-4098
Number of pages18
JournalPhysics in Medicine and Biology
Volume52
Issue number14
DOIs
StatePublished - Jul 21 2007

Fingerprint

Fiducial Markers
markers
Tumors
Respiration
Particle beam tracking
Radiotherapy
Liver
Imaging systems
Neoplasms
Fluoroscopy
General Hospitals
Anatomy
breathing
tumors

ASJC Scopus subject areas

  • Biomedical Engineering
  • Physics and Astronomy (miscellaneous)
  • Radiology Nuclear Medicine and imaging
  • Radiological and Ultrasound Technology

Cite this

Fluoroscopic tracking of multiple implanted fiducial markers using multiple object tracking. / Tang, Xiaoli; Sharp, Greg C.; Jiang, Steve B.

In: Physics in Medicine and Biology, Vol. 52, No. 14, 005, 21.07.2007, p. 4081-4098.

Research output: Contribution to journalArticle

@article{b099f5936ccf4e27a56abd75c871f48c,
title = "Fluoroscopic tracking of multiple implanted fiducial markers using multiple object tracking",
abstract = "When treating mobile tumors using techniques such as beam gating or beam tracking, precise localization of tumor position is required, which is often realized by fluoroscopically tracking implanted fiducial markers. Multiple markers placed inside or near a tumor are often preferred to a single marker for the sake of accuracy. In this work, we propose a marker tracking system that can track multiple markers simultaneously, without confusing them, and that is also robust enough to continue tracking even when the markers are moving behind bony anatomy. The integrated radiotherapy imaging system (IRIS), developed at the Massachusetts General Hospital (MGH), was used to take fluoroscopy videos for marker tracking. The tracking system integrates marker detection with a multiple object tracking process, inspired by the multiple hypothesis marker tracking (MHT) process. It also utilizes breathing pattern information to help tracking. Four criteria are used to identify tracking failure, and when tracking failure occurs, the system can immediately inform the user. (In the clinical environment, the system would immediately disable the treatment beam.) In this paper, two liver patients with implanted fiducial markers were studied, and the studies were performed retrospectively to assess the effectiveness of the new tracking system. For both patients, LAT and AP fluoroscopic videos were studied. In order to better test the proposed tracking system, artificial markers were added around the real markers to disturb the tracking of the real markers. The performance of the proposed system was compared to that of a conventional tracking system (one that did not use multiple object tracking). The performance of the new system was also investigated with and without consideration of the breathing pattern information. We found that the conventional tracking system can easily miss tracking markers in the presence of artificial markers, and it cannot detect the tracking failures. On the other hand, our proposed system can track markers well and can also successfully detect tracking failures. Failure rate was calculated on a per-frame-per-marker basis for the proposed tracking system. When the system considered breathing pattern information, it had a 0{\%} failure rate 75{\%} of the time and 0.4{\%} failure rate 25{\%} of the time. However, when the system did not consider breathing patterns, it had a much higher failure rate, in the range of 1.2{\%}-12{\%}. Both examples of the proposed system yielded low e95 (the maximum marker tracking error at 95{\%} confidence level) - less than 1.5 mm.",
author = "Xiaoli Tang and Sharp, {Greg C.} and Jiang, {Steve B.}",
year = "2007",
month = "7",
day = "21",
doi = "10.1088/0031-9155/52/14/005",
language = "English (US)",
volume = "52",
pages = "4081--4098",
journal = "Physics in Medicine and Biology",
issn = "0031-9155",
publisher = "IOP Publishing Ltd.",
number = "14",

}

TY - JOUR

T1 - Fluoroscopic tracking of multiple implanted fiducial markers using multiple object tracking

AU - Tang, Xiaoli

AU - Sharp, Greg C.

AU - Jiang, Steve B.

PY - 2007/7/21

Y1 - 2007/7/21

N2 - When treating mobile tumors using techniques such as beam gating or beam tracking, precise localization of tumor position is required, which is often realized by fluoroscopically tracking implanted fiducial markers. Multiple markers placed inside or near a tumor are often preferred to a single marker for the sake of accuracy. In this work, we propose a marker tracking system that can track multiple markers simultaneously, without confusing them, and that is also robust enough to continue tracking even when the markers are moving behind bony anatomy. The integrated radiotherapy imaging system (IRIS), developed at the Massachusetts General Hospital (MGH), was used to take fluoroscopy videos for marker tracking. The tracking system integrates marker detection with a multiple object tracking process, inspired by the multiple hypothesis marker tracking (MHT) process. It also utilizes breathing pattern information to help tracking. Four criteria are used to identify tracking failure, and when tracking failure occurs, the system can immediately inform the user. (In the clinical environment, the system would immediately disable the treatment beam.) In this paper, two liver patients with implanted fiducial markers were studied, and the studies were performed retrospectively to assess the effectiveness of the new tracking system. For both patients, LAT and AP fluoroscopic videos were studied. In order to better test the proposed tracking system, artificial markers were added around the real markers to disturb the tracking of the real markers. The performance of the proposed system was compared to that of a conventional tracking system (one that did not use multiple object tracking). The performance of the new system was also investigated with and without consideration of the breathing pattern information. We found that the conventional tracking system can easily miss tracking markers in the presence of artificial markers, and it cannot detect the tracking failures. On the other hand, our proposed system can track markers well and can also successfully detect tracking failures. Failure rate was calculated on a per-frame-per-marker basis for the proposed tracking system. When the system considered breathing pattern information, it had a 0% failure rate 75% of the time and 0.4% failure rate 25% of the time. However, when the system did not consider breathing patterns, it had a much higher failure rate, in the range of 1.2%-12%. Both examples of the proposed system yielded low e95 (the maximum marker tracking error at 95% confidence level) - less than 1.5 mm.

AB - When treating mobile tumors using techniques such as beam gating or beam tracking, precise localization of tumor position is required, which is often realized by fluoroscopically tracking implanted fiducial markers. Multiple markers placed inside or near a tumor are often preferred to a single marker for the sake of accuracy. In this work, we propose a marker tracking system that can track multiple markers simultaneously, without confusing them, and that is also robust enough to continue tracking even when the markers are moving behind bony anatomy. The integrated radiotherapy imaging system (IRIS), developed at the Massachusetts General Hospital (MGH), was used to take fluoroscopy videos for marker tracking. The tracking system integrates marker detection with a multiple object tracking process, inspired by the multiple hypothesis marker tracking (MHT) process. It also utilizes breathing pattern information to help tracking. Four criteria are used to identify tracking failure, and when tracking failure occurs, the system can immediately inform the user. (In the clinical environment, the system would immediately disable the treatment beam.) In this paper, two liver patients with implanted fiducial markers were studied, and the studies were performed retrospectively to assess the effectiveness of the new tracking system. For both patients, LAT and AP fluoroscopic videos were studied. In order to better test the proposed tracking system, artificial markers were added around the real markers to disturb the tracking of the real markers. The performance of the proposed system was compared to that of a conventional tracking system (one that did not use multiple object tracking). The performance of the new system was also investigated with and without consideration of the breathing pattern information. We found that the conventional tracking system can easily miss tracking markers in the presence of artificial markers, and it cannot detect the tracking failures. On the other hand, our proposed system can track markers well and can also successfully detect tracking failures. Failure rate was calculated on a per-frame-per-marker basis for the proposed tracking system. When the system considered breathing pattern information, it had a 0% failure rate 75% of the time and 0.4% failure rate 25% of the time. However, when the system did not consider breathing patterns, it had a much higher failure rate, in the range of 1.2%-12%. Both examples of the proposed system yielded low e95 (the maximum marker tracking error at 95% confidence level) - less than 1.5 mm.

UR - http://www.scopus.com/inward/record.url?scp=34547275812&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34547275812&partnerID=8YFLogxK

U2 - 10.1088/0031-9155/52/14/005

DO - 10.1088/0031-9155/52/14/005

M3 - Article

C2 - 17664596

AN - SCOPUS:34547275812

VL - 52

SP - 4081

EP - 4098

JO - Physics in Medicine and Biology

JF - Physics in Medicine and Biology

SN - 0031-9155

IS - 14

M1 - 005

ER -