The primacy of multimodal alignment in converging on shared symbols for novel referents
Number of pages
SourceDiscourse Processes, 59, 3, (2022), pp. 209-236
Article / Letter to editor
Display more detailsDisplay less details
PI Group Intention & Action
SW OZ DCC PL
Subject111 000 Intention & Action; Cultural Cognition and Multimodal Interaction; Language & Communication; Psycholinguistics
When people interact to establish shared symbols for novel objects or concepts, they often rely on multiple communicative modalities as well as on alignment (i.e., cross-participant repetition of communicative behavior). Yet these interactional resources have rarely been studied together, so little is known about if and how people combine multiple modalities in alignment to achieve joint reference. To investigate this, we systematically track the emergence of lexical and gestural alignment in a referential communication task with novel objects. Quantitative analyses reveal that people frequently use a combination of lexical and gestural alignment, and that such multimodal alignment tends to emerge earlier compared to unimodal alignment. Qualitative analyses of the interactional contexts in which alignment emerges reveal how people flexibly deploy lexical and gestural alignment in line with modality affordances and communicative needs.
Upload full text
Use your RU credentials (u/z-number and password) to log in with SURFconext to upload a file for processing by the repository team.