Thu-3-7-14 Classify Imaginary Mandarin Tones with Cortical EEG Signals

Abstract: Speech synthesis system based on non-invasive brain-computer interface technology has the potential to restore communication abilities to patients with communication disorders. To this end, electroencephalogram (EEG) based speech imagery technology is fast evolving largely due to its advantages of simple implementation and low dependence on external stimuli. This work studied possible factors accounting for the classification accuracies of EEG-based imaginary Mandarin tones, which has significance to the development of BCI-based Mandarin speech synthesis system. Specially, a Mandarin tone imagery experiment was designed, and this work studied effects of tone cuing and electrode configuration on accurately classifying four Mandarin tones from cortical EEG signals. Results showed that in the tone cue stage, using audio-visual stimuli led to a much stronger and more separable activation of brain regions than using visual-only stimuli. The involvement of more activated brain regions (i.e., Broca’s area, Wernicke’s area, and primary motor cortex) can provide a more accurate classification of imaginary Mandarin tones than that of one specific area. In addition, tone 1 and tone 4 have higher classification accuracies than tone 2 and tone 3.