Interictal epileptiform discharge detection in EEG in different practice settings

Objective: The goal of the study was to measure the performance of academic and private practice (PP) neurologists in detecting interictal epileptiform discharges in routine scalp EEG recordings. Methods: Thirty-five EEG scorers (EEGers) participated (19 academic and 16 PP) and marked the location of ETs in 200 30-second EEG segments using a web-based EEG annotation system. All participants provided board certification status, years of Epilepsy Fellowship Training (EFT), and years in practice. The Persyst P13 automated IED detection algorithm was also run on the EEG segments for comparison. Results: Academic EEGers had an average of 1.66 years of EFT versus 0.50 years of EFT for PP EEGers (P < 0.0001) and had higher rates of board certification. Inter-rater agreement for the 35 EEGers was fair. There was higher performance for EEGers in academics, with at least 1.5 years of EFT, and with American Board of Clinical Neurophysiology and American Board of Psychiatry and Neurology-E specialty board certification. The Persyst P13 algorithm at its default setting (perception value = 0.4) did not perform as well at the EEGers, but at substantially higher perception value settings, the algorithm performed almost as well human experts. Conclusions: Inter-rater agreement among EEGers in both academic and PP settings varies considerably. Practice location, years of EFT, and board certification are associated with significantly higher performance for IED detection in routine scalp EEG. Continued medical education of PP neurologists and neurologists without EFT is needed to improve routine scalp EEG interpretation skills. The performance of automated detection algorithms is approaching that of human experts.