Temporal window of integration in auditory-visual speech perception

Virginie van Wassenhove, Ken W. Grant, David Poeppel

Research output: Contribution to journalArticlepeer-review

Abstract

Forty-three normal hearing participants were tested in two experiments, which focused on temporal coincidence in auditory visual (AV) speech perception. In these experiments, audio recordings of/pa/and/ba/were dubbed onto video recordings of /ba/or/ga/, respectively (ApVk, AbVg), to produce the illusory "fusion" percepts /ta/, or /da/ [McGurk, H., & McDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-747]. In Experiment 1, an identification task using McGurk pairs with asynchronies ranging from -467 ms (auditory lead) to +467 ms was conducted. Fusion responses were prevalent over temporal asynchronies from -30 ms to +170 ms and more robust for audio lags. In Experiment 2, simultaneity judgments for incongruent and congruent audiovisual tokens (AdVd, AtVt) were collected. McGurk pairs were more readily judged as asynchronous than congruent pairs. Characteristics of the temporal window over which simultaneity and fusion responses were maximal were quite similar, suggesting the existence of a 200 ms duration asymmetric bimodal temporal integration window.

Original languageEnglish (US)
Pages (from-to)598-607
Number of pages10
JournalNeuropsychologia
Volume45
Issue number3
DOIs
StatePublished - 2007

Keywords

  • Analysis-by-synthesis
  • McGurk illusion
  • Multisensory
  • Psychophysics
  • Time

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Cognitive Neuroscience
  • Behavioral Neuroscience

Fingerprint Dive into the research topics of 'Temporal window of integration in auditory-visual speech perception'. Together they form a unique fingerprint.

Cite this