until further notice
Number of pages
SourceCognition, 133, 3, (2014), pp. 692-697
Article / Letter to editor
Display more detailsDisplay less details
SW OZ DCC PL
Subject110 000 Neurocognition of Language; DI-BCB_DCC_Theme 1: Language and Communication; Language in Mind; Language in our hands: Acquisition of spatial language in deaf and hearing children; Multimodal language and communication; Psycholinguistics; Relations between modality and language structure. Insights from comparisons of sign languages and gestures; niet-RU-publicaties
In human face-to-face communication, language comprehension is a multi-modal, situated activity. However, little is known about how we combine information from different modalities during comprehension, and how perceived communicative intentions, often signaled through visual signals, influence this process. We explored this question by simulating a multi-party communication context in which a speaker alternated her gaze between two recipients. Participants viewed speech-only or speech + gesture object-related messages when being addressed (direct gaze) or unaddressed (gaze averted to other participant). They were then asked to choose which of two object images matched the speaker's preceding message. Unaddressed recipients responded significantly more slowly than addressees for speech-only utterances. However, perceiving the same speech accompanied by gestures sped unaddressed recipients up to a level identical to that of addressees. That is, when unaddressed recipients' speech processing suffers, gestures can enhance the comprehension of a speaker's message. We discuss our findings with respect to two hypotheses attempting to account for how social eye gaze may modulate multi-modal language comprehension.
This item appears in the following Collection(s)
- Academic publications 
- Electronic publications 
- Faculty of Arts 
- Faculty of Social Sciences 
Upload full text
Use your RU credentials (u/z-number and password) to log in with SURFconext to upload a file for processing by the repository team.