dc.contributor.author | Brumberg, Jonathan S. | |
dc.contributor.author | Pitt, Kevin M. | |
dc.contributor.author | Burnison, Jeremy Dean | |
dc.date.accessioned | 2018-06-14T17:15:39Z | |
dc.date.available | 2018-06-14T17:15:39Z | |
dc.date.issued | 2018-04 | |
dc.identifier.citation | Brumberg, J. S., Pitt, K. M., & Burnison, J. D. (2018). A non-invasive brain-computer interface for real-time speech synthesis: The Importance of Multimodal Feedback. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 26(4), 874-881. DOI:10.1109/TNSRE.2018.2808425 | en_US |
dc.identifier.uri | http://hdl.handle.net/1808/26516 | |
dc.description.abstract | We conducted a study of a motor imagery brain-computer interface (BCI) using electroencephalography to continuously control a formant frequency speech synthesizer with instantaneous auditory and visual feedback. Over a three-session training period, sixteen participants learned to control the BCI for production of three vowel sounds (/ textipa i/ [heed], / textipa A/ [hot], and / textipa u/ [who'd]) and were split into three groups: those receiving unimodal auditory feedback of synthesized speech, those receiving unimodal visual feedback of formant frequencies, and those receiving multimodal, audio-visual (AV) feedback. Audio feedback was provided by a formant frequency artificial speech synthesizer, and visual feedback was given as a 2-D cursor on a graphical representation of the plane defined by the first two formant frequencies. We found that combined AV feedback led to the greatest performance in terms of percent accuracy, distance to target, and movement time to target compared with either unimodal feedback of auditory or visual information. These results indicate that performance is enhanced when multimodal feedback is meaningful for the BCI task goals, rather than as a generic biofeedback signal of BCI progress. | en_US |
dc.publisher | Institute of Electrical and Electronics Engineers | en_US |
dc.rights | © 2018 IEEE | en_US |
dc.title | A Noninvasive Brain-Computer Interface for Real-Time Speech Synthesis: The Importance of Multimodal Feedback. | en_US |
dc.type | Article | en_US |
kusw.kuauthor | Brumberg, Jonathan S. | |
kusw.kuauthor | Pitt, Kevin M. | |
kusw.kuauthor | Burnison, Jeremy D. | |
kusw.kudepartment | Speech-Language-Hearing | en_US |
kusw.oanotes | Per SHERPA/RoMEO 6/14/2018: Author's Pre-print: green tick author can archive pre-print (ie pre-refereeing)
Author's Post-print: green tick author can archive post-print (ie final draft post-refereeing)
Publisher's Version/PDF: cross author cannot archive publisher's version/PDF
General Conditions: Author's pre-print on any website or pre-print server
Author's post-print on author's personal website or employer's website or IEEE approved not-for-profit third party (8.1.9.G.2 ) website
Author's pre-print must be replaced by the accepted version, if on the author's personal website, employer's websites, arXiv, IEEE-approved third-party, not-for profit server, funder repository
Author's pre-print must removed on third-party servers
Author's pre-print must be accompanied with set phrase (see policy) before acceptance
Author's pre-print must be accompanied with set phrase (see policy) when accepted for publication
If funding agency rules apply, authors may post author's post-print version on funder's designated repository or institutional repository, in compliance with their funding agency rules. They may be required to comply with embargo periods of 0 to 24 months
Publisher copyright and source must be acknowledged with citation (see policy)
Must link to publisher version with DOI
Publisher's version/PDF cannot be used
Author's post-print on scholarly collaboration networks that have signed STM Sharing Principles
Publisher retains copyright | en_US |
dc.identifier.doi | 10.1109/TNSRE.2018.2808425 | en_US |
kusw.oaversion | Scholarly/refereed, author accepted manuscript | en_US |
kusw.oapolicy | This item meets KU Open Access policy criteria. | en_US |
dc.rights.accessrights | openAccess | |