Interrater reliability of a phenotypic assessment tool for the ear morphology in microtia

Daniela V. Luquetti, Babette S. Saltzman, Kathleen C. Sie, Craig B. Birgfeld, Brian G. Leroux, Kelly N. Evans, James M. Smartt, David D. Tieu, Daniel J. Dudley, Carrie L. Heike

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

The Elements of Morphology Standard Terminology working group published standardized definitions for external ear morphology. The primary objective of our study was to use these descriptions to evaluate the interrater reliability for specific features associated with microtia. We invited six raters from three different subspecialities to rate 100 ear photographs on 32 features. We calculated overall and within specialty and professional experience intraclass correlation coefficients (ICC) and 95% confidence intervals. A total of 600 possible observations were recorded for each feature. The overall interrater reliability ranged from 0.04 (95% CI: 0.00-0.14) for the width of the antihelix inferior crus to 0.93 (95% CI: 0.91-0.95) for the presence of the inferior crux of the antihelix. The reliability for quantitative characteristics such as length or width of an ear structure was generally lower than the reliability for qualitative characteristics (e.g., presence or absence of an ear structure). Categories with very poor interrater reliability included anti-helix inferior crux width (0.04, 95% CI: 0.00-0.14), crux helix extension (0.17, 95% CI 0.00-0.37), and shape of the incisura (0.14, 95% CI: 0.01-0.27). There were no significant differences in reliability estimates by specialty or professional experience for most variables. Our study showed that it is feasible to systematically characterize many of structures of the ear that are affected in microtia. We incorporated these descriptions into a standardized phenotypic assessment tool (PAT-Microtia) that might be used in multicenter research studies to identify sub-phenotypes for future studies of microtia.

Original languageEnglish (US)
Pages (from-to)1264-1272
Number of pages9
JournalAmerican Journal of Medical Genetics, Part A
Volume161
Issue number6
DOIs
StatePublished - Jun 2013

Fingerprint

Ear
External Ear
Terminology
Multicenter Studies
Confidence Intervals
Phenotype
Congenital Microtia
Research

Keywords

  • Ear morphology
  • Microtia
  • Phenotype
  • Reliability

ASJC Scopus subject areas

  • Genetics(clinical)
  • Genetics

Cite this

Luquetti, D. V., Saltzman, B. S., Sie, K. C., Birgfeld, C. B., Leroux, B. G., Evans, K. N., ... Heike, C. L. (2013). Interrater reliability of a phenotypic assessment tool for the ear morphology in microtia. American Journal of Medical Genetics, Part A, 161(6), 1264-1272. https://doi.org/10.1002/ajmg.a.35963

Interrater reliability of a phenotypic assessment tool for the ear morphology in microtia. / Luquetti, Daniela V.; Saltzman, Babette S.; Sie, Kathleen C.; Birgfeld, Craig B.; Leroux, Brian G.; Evans, Kelly N.; Smartt, James M.; Tieu, David D.; Dudley, Daniel J.; Heike, Carrie L.

In: American Journal of Medical Genetics, Part A, Vol. 161, No. 6, 06.2013, p. 1264-1272.

Research output: Contribution to journalArticle

Luquetti, DV, Saltzman, BS, Sie, KC, Birgfeld, CB, Leroux, BG, Evans, KN, Smartt, JM, Tieu, DD, Dudley, DJ & Heike, CL 2013, 'Interrater reliability of a phenotypic assessment tool for the ear morphology in microtia', American Journal of Medical Genetics, Part A, vol. 161, no. 6, pp. 1264-1272. https://doi.org/10.1002/ajmg.a.35963
Luquetti, Daniela V. ; Saltzman, Babette S. ; Sie, Kathleen C. ; Birgfeld, Craig B. ; Leroux, Brian G. ; Evans, Kelly N. ; Smartt, James M. ; Tieu, David D. ; Dudley, Daniel J. ; Heike, Carrie L. / Interrater reliability of a phenotypic assessment tool for the ear morphology in microtia. In: American Journal of Medical Genetics, Part A. 2013 ; Vol. 161, No. 6. pp. 1264-1272.
@article{7246f44a1ddb4e18952599df5d13538e,
title = "Interrater reliability of a phenotypic assessment tool for the ear morphology in microtia",
abstract = "The Elements of Morphology Standard Terminology working group published standardized definitions for external ear morphology. The primary objective of our study was to use these descriptions to evaluate the interrater reliability for specific features associated with microtia. We invited six raters from three different subspecialities to rate 100 ear photographs on 32 features. We calculated overall and within specialty and professional experience intraclass correlation coefficients (ICC) and 95{\%} confidence intervals. A total of 600 possible observations were recorded for each feature. The overall interrater reliability ranged from 0.04 (95{\%} CI: 0.00-0.14) for the width of the antihelix inferior crus to 0.93 (95{\%} CI: 0.91-0.95) for the presence of the inferior crux of the antihelix. The reliability for quantitative characteristics such as length or width of an ear structure was generally lower than the reliability for qualitative characteristics (e.g., presence or absence of an ear structure). Categories with very poor interrater reliability included anti-helix inferior crux width (0.04, 95{\%} CI: 0.00-0.14), crux helix extension (0.17, 95{\%} CI 0.00-0.37), and shape of the incisura (0.14, 95{\%} CI: 0.01-0.27). There were no significant differences in reliability estimates by specialty or professional experience for most variables. Our study showed that it is feasible to systematically characterize many of structures of the ear that are affected in microtia. We incorporated these descriptions into a standardized phenotypic assessment tool (PAT-Microtia) that might be used in multicenter research studies to identify sub-phenotypes for future studies of microtia.",
keywords = "Ear morphology, Microtia, Phenotype, Reliability",
author = "Luquetti, {Daniela V.} and Saltzman, {Babette S.} and Sie, {Kathleen C.} and Birgfeld, {Craig B.} and Leroux, {Brian G.} and Evans, {Kelly N.} and Smartt, {James M.} and Tieu, {David D.} and Dudley, {Daniel J.} and Heike, {Carrie L.}",
year = "2013",
month = "6",
doi = "10.1002/ajmg.a.35963",
language = "English (US)",
volume = "161",
pages = "1264--1272",
journal = "American Journal of Medical Genetics, Part A",
issn = "1552-4825",
publisher = "Wiley-Liss Inc.",
number = "6",

}

TY - JOUR

T1 - Interrater reliability of a phenotypic assessment tool for the ear morphology in microtia

AU - Luquetti, Daniela V.

AU - Saltzman, Babette S.

AU - Sie, Kathleen C.

AU - Birgfeld, Craig B.

AU - Leroux, Brian G.

AU - Evans, Kelly N.

AU - Smartt, James M.

AU - Tieu, David D.

AU - Dudley, Daniel J.

AU - Heike, Carrie L.

PY - 2013/6

Y1 - 2013/6

N2 - The Elements of Morphology Standard Terminology working group published standardized definitions for external ear morphology. The primary objective of our study was to use these descriptions to evaluate the interrater reliability for specific features associated with microtia. We invited six raters from three different subspecialities to rate 100 ear photographs on 32 features. We calculated overall and within specialty and professional experience intraclass correlation coefficients (ICC) and 95% confidence intervals. A total of 600 possible observations were recorded for each feature. The overall interrater reliability ranged from 0.04 (95% CI: 0.00-0.14) for the width of the antihelix inferior crus to 0.93 (95% CI: 0.91-0.95) for the presence of the inferior crux of the antihelix. The reliability for quantitative characteristics such as length or width of an ear structure was generally lower than the reliability for qualitative characteristics (e.g., presence or absence of an ear structure). Categories with very poor interrater reliability included anti-helix inferior crux width (0.04, 95% CI: 0.00-0.14), crux helix extension (0.17, 95% CI 0.00-0.37), and shape of the incisura (0.14, 95% CI: 0.01-0.27). There were no significant differences in reliability estimates by specialty or professional experience for most variables. Our study showed that it is feasible to systematically characterize many of structures of the ear that are affected in microtia. We incorporated these descriptions into a standardized phenotypic assessment tool (PAT-Microtia) that might be used in multicenter research studies to identify sub-phenotypes for future studies of microtia.

AB - The Elements of Morphology Standard Terminology working group published standardized definitions for external ear morphology. The primary objective of our study was to use these descriptions to evaluate the interrater reliability for specific features associated with microtia. We invited six raters from three different subspecialities to rate 100 ear photographs on 32 features. We calculated overall and within specialty and professional experience intraclass correlation coefficients (ICC) and 95% confidence intervals. A total of 600 possible observations were recorded for each feature. The overall interrater reliability ranged from 0.04 (95% CI: 0.00-0.14) for the width of the antihelix inferior crus to 0.93 (95% CI: 0.91-0.95) for the presence of the inferior crux of the antihelix. The reliability for quantitative characteristics such as length or width of an ear structure was generally lower than the reliability for qualitative characteristics (e.g., presence or absence of an ear structure). Categories with very poor interrater reliability included anti-helix inferior crux width (0.04, 95% CI: 0.00-0.14), crux helix extension (0.17, 95% CI 0.00-0.37), and shape of the incisura (0.14, 95% CI: 0.01-0.27). There were no significant differences in reliability estimates by specialty or professional experience for most variables. Our study showed that it is feasible to systematically characterize many of structures of the ear that are affected in microtia. We incorporated these descriptions into a standardized phenotypic assessment tool (PAT-Microtia) that might be used in multicenter research studies to identify sub-phenotypes for future studies of microtia.

KW - Ear morphology

KW - Microtia

KW - Phenotype

KW - Reliability

UR - http://www.scopus.com/inward/record.url?scp=84878254666&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84878254666&partnerID=8YFLogxK

U2 - 10.1002/ajmg.a.35963

DO - 10.1002/ajmg.a.35963

M3 - Article

VL - 161

SP - 1264

EP - 1272

JO - American Journal of Medical Genetics, Part A

JF - American Journal of Medical Genetics, Part A

SN - 1552-4825

IS - 6

ER -