TY - GEN
T1 - Optimizing P300 speller performance using language models for character and word prediction
AU - Parthasarathy, Nithin
AU - Arnold, Corey
AU - Pouratian, Nader
AU - Speier, William
N1 - Publisher Copyright:
© 2020 IEEE.
PY - 2020/10
Y1 - 2020/10
N2 - Neurodegenerative diseases such as Amyotrophic Lateral Sclerosis (ALS) restrict an individual's ability to fully engage with their surroundings by interrupting crucial cell signaling processes between the brain and the peripheral nervous system. In such cases, brain-computer interfaces (BCI) such as the P300 speller use electroencephalography (EEG) to capture subject brain signals which are decoded to provide an alternate channel for communication. This paper develops new and sophisticated BCI techniques combining language models, probabilistic flashboard design, and optimal scanning techniques which together with smoothing algorithms and word suggestions can be effectively utilized as a form of predictive spelling. Detailed offline simulations based on subject EEG data allowed for testing a variety of methods on a large subject population producing extensive output text including both in vocabulary and out of vocabulary words. Significant performance gains were seen when applying language models to classification and optimizing the interface for stimulus presentation. The results demonstrate that feed-forward techniques with appropriate flashboard design and word completion algorithms can achieve similar or better performance as more complex feedback schemes. Consequently, one can employ lower complexity flashboard as well as control and yet achieve the performance gains offered by more complex techniques.
AB - Neurodegenerative diseases such as Amyotrophic Lateral Sclerosis (ALS) restrict an individual's ability to fully engage with their surroundings by interrupting crucial cell signaling processes between the brain and the peripheral nervous system. In such cases, brain-computer interfaces (BCI) such as the P300 speller use electroencephalography (EEG) to capture subject brain signals which are decoded to provide an alternate channel for communication. This paper develops new and sophisticated BCI techniques combining language models, probabilistic flashboard design, and optimal scanning techniques which together with smoothing algorithms and word suggestions can be effectively utilized as a form of predictive spelling. Detailed offline simulations based on subject EEG data allowed for testing a variety of methods on a large subject population producing extensive output text including both in vocabulary and out of vocabulary words. Significant performance gains were seen when applying language models to classification and optimizing the interface for stimulus presentation. The results demonstrate that feed-forward techniques with appropriate flashboard design and word completion algorithms can achieve similar or better performance as more complex feedback schemes. Consequently, one can employ lower complexity flashboard as well as control and yet achieve the performance gains offered by more complex techniques.
KW - ALS
KW - BCI
KW - Brain Computer Interface
KW - P300
UR - http://www.scopus.com/inward/record.url?scp=85099551778&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85099551778&partnerID=8YFLogxK
U2 - 10.1109/BIBE50027.2020.00137
DO - 10.1109/BIBE50027.2020.00137
M3 - Conference contribution
AN - SCOPUS:85099551778
T3 - Proceedings - IEEE 20th International Conference on Bioinformatics and Bioengineering, BIBE 2020
SP - 807
EP - 812
BT - Proceedings - IEEE 20th International Conference on Bioinformatics and Bioengineering, BIBE 2020
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 20th IEEE International Conference on Bioinformatics and Bioengineering, BIBE 2020
Y2 - 26 October 2020 through 28 October 2020
ER -