Energy flows in gesture-speech physics: The respiratory-vocal system and its coupling with hand gestures

Fulltext:
221877.pdf
Embargo:
until further notice
Size:
4.745Mb
Format:
PDF
Description:
Publisher’s version
Publication year
2020Number of pages
17 p.
Source
The Journal of the Acoustical Society of America, 148, 3, (2020), pp. 1231-1247ISSN
Publication type
Article / Letter to editor

Display more detailsDisplay less details
Organization
SW OZ DCC PL
Journal title
The Journal of the Acoustical Society of America
Volume
vol. 148
Issue
iss. 3
Languages used
English (eng)
Page start
p. 1231
Page end
p. 1247
Subject
PsycholinguisticsAbstract
Expressive moments in communicative hand gestures often align with emphatic stress in speech. It has recently been found that acoustic markers of emphatic stress arise naturally during steady-state phonation when upper-limb movements impart physical impulses on the body, most likely affecting acoustics via respiratory activity. In this confirmatory study, participants (N = 29) repeatedly uttered consonant-vowel (/pa/) mono-syllables while moving in particular phase relations with speech, or not moving the upper limbs. This study shows that respiration-related activity is affected by (especially high-impulse) gesturing when vocalizations occur near peaks in physical impulse. This study further shows that gesture-induced moments of bodily impulses increase the amplitude envelope of speech, while not similarly affecting the Fundamental Frequency (F0). Finally, tight relations between respiration-related activity and vocalization were observed, even in the absence of movement, but even more so when upper-limb movement is present. The current findings expand a developing line of research showing that speech is modulated by functional biomechanical linkages between hand gestures and the respiratory system. This identification of gesture-speech biomechanics promises to provide an alternative phylogenetic, ontogenetic, and mechanistic explanatory route of why communicative upper limb movements co-occur with speech in humans.
This item appears in the following Collection(s)
- Academic publications [229339]
- Electronic publications [111770]
- Faculty of Social Sciences [28735]
Upload full text
Use your RU credentials (u/z-number and password) to log in with SURFconext to upload a file for processing by the repository team.