TY - GEN
T1 - Reconstructing Speech Stimuli From Human Auditory Cortex Activity Using a WaveNet Approach
AU - Wang, Ran
AU - Wang, Yao
AU - Flinker, Adeen
N1 - Publisher Copyright:
© 2018 IEEE.
PY - 2018/7/2
Y1 - 2018/7/2
N2 - The superior temporal gyrus (STG) region of cortex critically contributes to speech recognition. In this work, we show that a proposed WaveNet, with limited available data, is able to reconstruct speech stimuli from STG intracranial recordings. We further investigate the impulse response of the fitted model for each recording electrode and observe phoneme level temporospectral tuning properties for the recorded area of cortex. This discovery is consistent with previous studies implicating the posterior STG (pSTG) in a phonetic representation of speech and provides detailed acoustic features that certain electrode sites possibly extract during speech recognition.
AB - The superior temporal gyrus (STG) region of cortex critically contributes to speech recognition. In this work, we show that a proposed WaveNet, with limited available data, is able to reconstruct speech stimuli from STG intracranial recordings. We further investigate the impulse response of the fitted model for each recording electrode and observe phoneme level temporospectral tuning properties for the recorded area of cortex. This discovery is consistent with previous studies implicating the posterior STG (pSTG) in a phonetic representation of speech and provides detailed acoustic features that certain electrode sites possibly extract during speech recognition.
UR - http://www.scopus.com/inward/record.url?scp=85062060563&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85062060563&partnerID=8YFLogxK
U2 - 10.1109/SPMB.2018.8615605
DO - 10.1109/SPMB.2018.8615605
M3 - Conference contribution
AN - SCOPUS:85062060563
T3 - 2018 IEEE Signal Processing in Medicine and Biology Symposium, SPMB 2018 - Proceedings
BT - 2018 IEEE Signal Processing in Medicine and Biology Symposium, SPMB 2018 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2018 IEEE Signal Processing in Medicine and Biology Symposium, SPMB 2018
Y2 - 1 December 2018
ER -