Show simple item record

dc.contributor.authorBrumberg, Jonathan S.
dc.contributor.authorPitt, Kevin M.
dc.contributor.authorBurnison, Jeremy Dean
dc.identifier.citationBrumberg, J. S., Pitt, K. M., & Burnison, J. D. (2018). A non-invasive brain-computer interface for real-time speech synthesis: The Importance of Multimodal Feedback. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 26(4), 874-881. DOI:10.1109/TNSRE.2018.2808425en_US
dc.description.abstractWe conducted a study of a motor imagery brain-computer interface (BCI) using electroencephalography to continuously control a formant frequency speech synthesizer with instantaneous auditory and visual feedback. Over a three-session training period, sixteen participants learned to control the BCI for production of three vowel sounds (/ textipa i/ [heed], / textipa A/ [hot], and / textipa u/ [who'd]) and were split into three groups: those receiving unimodal auditory feedback of synthesized speech, those receiving unimodal visual feedback of formant frequencies, and those receiving multimodal, audio-visual (AV) feedback. Audio feedback was provided by a formant frequency artificial speech synthesizer, and visual feedback was given as a 2-D cursor on a graphical representation of the plane defined by the first two formant frequencies. We found that combined AV feedback led to the greatest performance in terms of percent accuracy, distance to target, and movement time to target compared with either unimodal feedback of auditory or visual information. These results indicate that performance is enhanced when multimodal feedback is meaningful for the BCI task goals, rather than as a generic biofeedback signal of BCI progress.en_US
dc.publisherInstitute of Electrical and Electronics Engineersen_US
dc.rights© 2018 IEEEen_US
dc.titleA Noninvasive Brain-Computer Interface for Real-Time Speech Synthesis: The Importance of Multimodal Feedback.en_US
kusw.kuauthorBrumberg, Jonathan S.
kusw.kuauthorPitt, Kevin M.
kusw.kuauthorBurnison, Jeremy D.
kusw.oanotesPer SHERPA/RoMEO 6/14/2018: Author's Pre-print: green tick author can archive pre-print (ie pre-refereeing) Author's Post-print: green tick author can archive post-print (ie final draft post-refereeing) Publisher's Version/PDF: cross author cannot archive publisher's version/PDF General Conditions:

Author's pre-print on any website or pre-print server Author's post-print on author's personal website or employer's website or IEEE approved not-for-profit third party (8.1.9.G.2 ) website Author's pre-print must be replaced by the accepted version, if on the author's personal website, employer's websites, arXiv, IEEE-approved third-party, not-for profit server, funder repository Author's pre-print must removed on third-party servers Author's pre-print must be accompanied with set phrase (see policy) before acceptance Author's pre-print must be accompanied with set phrase (see policy) when accepted for publication If funding agency rules apply, authors may post author's post-print version on funder's designated repository or institutional repository, in compliance with their funding agency rules. They may be required to comply with embargo periods of 0 to 24 months Publisher copyright and source must be acknowledged with citation (see policy) Must link to publisher version with DOI Publisher's version/PDF cannot be used Author's post-print on scholarly collaboration networks that have signed STM Sharing Principles Publisher retains copyright
kusw.oaversionScholarly/refereed, author accepted manuscripten_US
kusw.oapolicyThis item meets KU Open Access policy criteria.en_US

Files in this item


This item appears in the following Collection(s)

Show simple item record