The kappa statistic was representative of empirically observed inter-rater agreement for physical findings

Marc H. Gorelick, Kenneth Yen

Research output: Contribution to journalArticle

8 Scopus citations

Abstract

Background and Objective: To determine empirically chance agreement between different clinicians evaluating physical examination findings in children with acute abdominal pain. Materials and Methods: Cross-sectional study of children age 3 to 18 years treated in a pediatric emergency department for acute abdominal pain. Three different examiners were provided the same historic information and asked to predict, independently and prior to examining the patient, the presence or absence of seven different clinical findings. Agreement between pairs of observers on these predicted findings was determined, and was defined as observed chance agreement. Actual examination findings were also recorded, and expected agreement due to chance was determined from the kappa statistic calculation. Results: There were 68 pair of observations between two pediatric examiners, and 46 pair between pediatric and surgical examiners. Observed and expected chance agreement were very similar for six of the seven clinical findings. Agreement beyond chance for the actual exam findings was generally poor, with kappa less than 0.5 for all but one finding. Conclusions: Expected chance agreement, as calculated from the kappa statistic, is a reasonable reflection of empirically observed chance agreement between clinicians.

Original languageEnglish (US)
Pages (from-to)859-861
Number of pages3
JournalJournal of Clinical Epidemiology
Volume59
Issue number8
DOIs
StatePublished - Aug 1 2006

Keywords

  • Diagnostic errors
  • Interobserver agreement
  • Kappa statistic
  • Observer variation

ASJC Scopus subject areas

  • Epidemiology

Fingerprint Dive into the research topics of 'The kappa statistic was representative of empirically observed inter-rater agreement for physical findings'. Together they form a unique fingerprint.

  • Cite this