Native language status of the listener modulates the neural integration of speech and iconic gestures in clear and adverse listening conditions
SourceBrain and Language, vol. 177-178, (2018), pp. 7-17
Article / Letter to editor
Display more detailsDisplay less details
PI Group Neurobiology of Language
SW OZ DCC PL
Brain and Language
vol. vol. 177-178
SubjectDI-BCB_DCC_Theme 1: Language and Communication; Giving cognition a hand: Linking spatial cognition to linguistic expression in native and late signers and bimodal bilinguals; Giving speech a hand: How functional brain networks support gestureal enhancement of language; Language & Communication; Language in our hands: Acquisition of spatial language in deaf and hearing children; Multimodal language and communication; Psycholinguistics; Language in Interaction
Native listeners neurally integrate iconic gestures with speech, which can enhance degraded speech comprehension. However, it is unknown how non-native listeners neurally integrate speech and gestures, as they might process visual semantic context differently than natives. We recorded EEG while native and highly-proficient non-native listeners watched videos of an actress uttering an action verb in clear or degraded speech, accompanied by a matching ('to drive'+driving gesture) or mismatching gesture ('to drink'+mixing gesture). Degraded speech elicited an enhanced N400 amplitude compared to clear speech in both groups, revealing an increase in neural resources needed to resolve the spoken input. A larger N400 effect was found in clear speech for non-natives compared to natives, but in degraded speech only for natives. Non-native listeners might thus process gesture more strongly than natives when speech is clear, but need more auditory cues to facilitate access to gestural semantic information when speech is degraded.
NWO (Grant code:info:eu-repo/grantAgreement/NWO/Gravitation/024.001.006)
Upload full text
Use your RU credentials (u/z-number and password) to log in with SURFconext to upload a file for processing by the repository team.