International assessment of inter- and intrarater reliability of the International Frontal Sinus Anatomy Classification system

Ricardo Villarreal, Bozena B. Wrobel, Luis F. Macias-Valle, Greg E. Davis, Thomas J. Prihoda, Amber U. Luong, K. Christopher McMains, Erik K. Weitzel, William C. Yao, Joe Brunworth, David W. Clark, Salil Nair, Constanza J. Valdés, Ashleigh Halderman, David W. Jang, Rahuram Sivasubramaniam, Zhipeng Zhang, Philip G. Chen

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Background: Inconsistencies in the nomenclature of structures of the frontal sinus have impeded the development of a validated “reference standard” classification system that surgeons can reliably agree upon. The International Frontal Sinus Anatomy Classification (IFAC) system was developed as a consensus document, based on expert opinion, attempting to address this issue. The purposes of this study are to: establish the reliability of the IFAC as a tool for classifying cells in the frontal recess among an international group of rhinologists; and improve communication and teaching of frontal endoscopic sinus surgery (ESS). Methods: Forty-two computed tomography (CT) scans, each with a marked frontal cell, were reviewed by 15 international fellowship-trained rhinologists. Each marked cell was classified into 1 of 7 categories described in the IFAC, on 2 occasions separated by 2 weeks. Inter- and intrarater reliability were evaluated using Light's kappa (κ), the interclass correlation coefficient (ICC), and simple proportion of agreement. Results: Interrater reliability showed pairwise κ values ranging from 0.7248 to 1.0, with a mean of 0.9162 (SD, 0.0537). The ICC was 0.98. Intrarater reliability showed κ values ranging from 0.8613 to 1.0, with a mean of 0.9407 (SD, 0.0376). The within-rater ICC was 0.98. Conclusion: Among a diverse sample of rhinologists (raters), there was substantial to almost perfect agreement between raters, and among individual raters at different timepoints. The IFAC is a reliable tool for classification of cells in the frontal sinus. Further outcome studies are still needed to determine the validity of the IFAC.

Original languageEnglish (US)
JournalInternational Forum of Allergy and Rhinology
DOIs
StateAccepted/In press - Jan 1 2018

Fingerprint

Frontal Sinus
Anatomy
Expert Testimony
Terminology
Reproducibility of Results
Consensus
Teaching
Communication
Tomography
Outcome Assessment (Health Care)

Keywords

  • computed tomography
  • endoscopic sinus surgery
  • paranasal sinuses
  • sinus anatomy
  • statistics

ASJC Scopus subject areas

  • Immunology and Allergy
  • Otorhinolaryngology

Cite this

Villarreal, R., Wrobel, B. B., Macias-Valle, L. F., Davis, G. E., Prihoda, T. J., Luong, A. U., ... Chen, P. G. (Accepted/In press). International assessment of inter- and intrarater reliability of the International Frontal Sinus Anatomy Classification system. International Forum of Allergy and Rhinology. https://doi.org/10.1002/alr.22200

International assessment of inter- and intrarater reliability of the International Frontal Sinus Anatomy Classification system. / Villarreal, Ricardo; Wrobel, Bozena B.; Macias-Valle, Luis F.; Davis, Greg E.; Prihoda, Thomas J.; Luong, Amber U.; McMains, K. Christopher; Weitzel, Erik K.; Yao, William C.; Brunworth, Joe; Clark, David W.; Nair, Salil; Valdés, Constanza J.; Halderman, Ashleigh; Jang, David W.; Sivasubramaniam, Rahuram; Zhang, Zhipeng; Chen, Philip G.

In: International Forum of Allergy and Rhinology, 01.01.2018.

Research output: Contribution to journalArticle

Villarreal, R, Wrobel, BB, Macias-Valle, LF, Davis, GE, Prihoda, TJ, Luong, AU, McMains, KC, Weitzel, EK, Yao, WC, Brunworth, J, Clark, DW, Nair, S, Valdés, CJ, Halderman, A, Jang, DW, Sivasubramaniam, R, Zhang, Z & Chen, PG 2018, 'International assessment of inter- and intrarater reliability of the International Frontal Sinus Anatomy Classification system', International Forum of Allergy and Rhinology. https://doi.org/10.1002/alr.22200
Villarreal, Ricardo ; Wrobel, Bozena B. ; Macias-Valle, Luis F. ; Davis, Greg E. ; Prihoda, Thomas J. ; Luong, Amber U. ; McMains, K. Christopher ; Weitzel, Erik K. ; Yao, William C. ; Brunworth, Joe ; Clark, David W. ; Nair, Salil ; Valdés, Constanza J. ; Halderman, Ashleigh ; Jang, David W. ; Sivasubramaniam, Rahuram ; Zhang, Zhipeng ; Chen, Philip G. / International assessment of inter- and intrarater reliability of the International Frontal Sinus Anatomy Classification system. In: International Forum of Allergy and Rhinology. 2018.
@article{51a0d1dc478d483fabbf7835a236f279,
title = "International assessment of inter- and intrarater reliability of the International Frontal Sinus Anatomy Classification system",
abstract = "Background: Inconsistencies in the nomenclature of structures of the frontal sinus have impeded the development of a validated “reference standard” classification system that surgeons can reliably agree upon. The International Frontal Sinus Anatomy Classification (IFAC) system was developed as a consensus document, based on expert opinion, attempting to address this issue. The purposes of this study are to: establish the reliability of the IFAC as a tool for classifying cells in the frontal recess among an international group of rhinologists; and improve communication and teaching of frontal endoscopic sinus surgery (ESS). Methods: Forty-two computed tomography (CT) scans, each with a marked frontal cell, were reviewed by 15 international fellowship-trained rhinologists. Each marked cell was classified into 1 of 7 categories described in the IFAC, on 2 occasions separated by 2 weeks. Inter- and intrarater reliability were evaluated using Light's kappa (κ), the interclass correlation coefficient (ICC), and simple proportion of agreement. Results: Interrater reliability showed pairwise κ values ranging from 0.7248 to 1.0, with a mean of 0.9162 (SD, 0.0537). The ICC was 0.98. Intrarater reliability showed κ values ranging from 0.8613 to 1.0, with a mean of 0.9407 (SD, 0.0376). The within-rater ICC was 0.98. Conclusion: Among a diverse sample of rhinologists (raters), there was substantial to almost perfect agreement between raters, and among individual raters at different timepoints. The IFAC is a reliable tool for classification of cells in the frontal sinus. Further outcome studies are still needed to determine the validity of the IFAC.",
keywords = "computed tomography, endoscopic sinus surgery, paranasal sinuses, sinus anatomy, statistics",
author = "Ricardo Villarreal and Wrobel, {Bozena B.} and Macias-Valle, {Luis F.} and Davis, {Greg E.} and Prihoda, {Thomas J.} and Luong, {Amber U.} and McMains, {K. Christopher} and Weitzel, {Erik K.} and Yao, {William C.} and Joe Brunworth and Clark, {David W.} and Salil Nair and Vald{\'e}s, {Constanza J.} and Ashleigh Halderman and Jang, {David W.} and Rahuram Sivasubramaniam and Zhipeng Zhang and Chen, {Philip G.}",
year = "2018",
month = "1",
day = "1",
doi = "10.1002/alr.22200",
language = "English (US)",
journal = "International Forum of Allergy and Rhinology",
issn = "2042-6976",
publisher = "Wiley-Blackwell",

}

TY - JOUR

T1 - International assessment of inter- and intrarater reliability of the International Frontal Sinus Anatomy Classification system

AU - Villarreal, Ricardo

AU - Wrobel, Bozena B.

AU - Macias-Valle, Luis F.

AU - Davis, Greg E.

AU - Prihoda, Thomas J.

AU - Luong, Amber U.

AU - McMains, K. Christopher

AU - Weitzel, Erik K.

AU - Yao, William C.

AU - Brunworth, Joe

AU - Clark, David W.

AU - Nair, Salil

AU - Valdés, Constanza J.

AU - Halderman, Ashleigh

AU - Jang, David W.

AU - Sivasubramaniam, Rahuram

AU - Zhang, Zhipeng

AU - Chen, Philip G.

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Background: Inconsistencies in the nomenclature of structures of the frontal sinus have impeded the development of a validated “reference standard” classification system that surgeons can reliably agree upon. The International Frontal Sinus Anatomy Classification (IFAC) system was developed as a consensus document, based on expert opinion, attempting to address this issue. The purposes of this study are to: establish the reliability of the IFAC as a tool for classifying cells in the frontal recess among an international group of rhinologists; and improve communication and teaching of frontal endoscopic sinus surgery (ESS). Methods: Forty-two computed tomography (CT) scans, each with a marked frontal cell, were reviewed by 15 international fellowship-trained rhinologists. Each marked cell was classified into 1 of 7 categories described in the IFAC, on 2 occasions separated by 2 weeks. Inter- and intrarater reliability were evaluated using Light's kappa (κ), the interclass correlation coefficient (ICC), and simple proportion of agreement. Results: Interrater reliability showed pairwise κ values ranging from 0.7248 to 1.0, with a mean of 0.9162 (SD, 0.0537). The ICC was 0.98. Intrarater reliability showed κ values ranging from 0.8613 to 1.0, with a mean of 0.9407 (SD, 0.0376). The within-rater ICC was 0.98. Conclusion: Among a diverse sample of rhinologists (raters), there was substantial to almost perfect agreement between raters, and among individual raters at different timepoints. The IFAC is a reliable tool for classification of cells in the frontal sinus. Further outcome studies are still needed to determine the validity of the IFAC.

AB - Background: Inconsistencies in the nomenclature of structures of the frontal sinus have impeded the development of a validated “reference standard” classification system that surgeons can reliably agree upon. The International Frontal Sinus Anatomy Classification (IFAC) system was developed as a consensus document, based on expert opinion, attempting to address this issue. The purposes of this study are to: establish the reliability of the IFAC as a tool for classifying cells in the frontal recess among an international group of rhinologists; and improve communication and teaching of frontal endoscopic sinus surgery (ESS). Methods: Forty-two computed tomography (CT) scans, each with a marked frontal cell, were reviewed by 15 international fellowship-trained rhinologists. Each marked cell was classified into 1 of 7 categories described in the IFAC, on 2 occasions separated by 2 weeks. Inter- and intrarater reliability were evaluated using Light's kappa (κ), the interclass correlation coefficient (ICC), and simple proportion of agreement. Results: Interrater reliability showed pairwise κ values ranging from 0.7248 to 1.0, with a mean of 0.9162 (SD, 0.0537). The ICC was 0.98. Intrarater reliability showed κ values ranging from 0.8613 to 1.0, with a mean of 0.9407 (SD, 0.0376). The within-rater ICC was 0.98. Conclusion: Among a diverse sample of rhinologists (raters), there was substantial to almost perfect agreement between raters, and among individual raters at different timepoints. The IFAC is a reliable tool for classification of cells in the frontal sinus. Further outcome studies are still needed to determine the validity of the IFAC.

KW - computed tomography

KW - endoscopic sinus surgery

KW - paranasal sinuses

KW - sinus anatomy

KW - statistics

UR - http://www.scopus.com/inward/record.url?scp=85053453573&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85053453573&partnerID=8YFLogxK

U2 - 10.1002/alr.22200

DO - 10.1002/alr.22200

M3 - Article

JO - International Forum of Allergy and Rhinology

JF - International Forum of Allergy and Rhinology

SN - 2042-6976

ER -