The combined use of virtual reality and EEG to study language processing in naturalistic environments
SourceBehavior Research Methods, 50, 2, (2018), pp. 862-869
Article / Letter to editor
Display more detailsDisplay less details
SW OZ DCC BO
SW OZ DCC PL
PI Group Neurobiology of Language
Behavior Research Methods
Subject110 000 Neurocognition of Language; DI-BCB_DCC_Theme 1: Language and Communication; Psycholinguistics
When we comprehend language, we often do this in rich settings where we can use many cues to understand what someone is saying. However, it has traditionally been difficult to design experiments with rich three-dimensional contexts that resemble our everyday environments, while maintaining control over the linguistic and nonlinguistic information that is available. Here we test the validity of combining electroencephalography (EEG) and virtual reality (VR) to overcome this problem. We recorded electrophysiological brain activity during language processing in a well-controlled three-dimensional virtual audiovisual environment. Participants were immersed in a virtual restaurant while wearing EEG equipment. In the restaurant, participants encountered virtual restaurant guests. Each guest was seated at a separate table with an object on it (e.g., a plate with salmon). The restaurant guest would then produce a sentence (e.g., "I just ordered this salmon."). The noun in the spoken sentence could either match ("salmon") or mismatch ("pasta") the object on the table, creating a situation in which the auditory information was either appropriate or inappropriate in the visual context. We observed a reliable N400 effect as a consequence of the mismatch. This finding validates the combined use of VR and EEG as a tool to study the neurophysiological mechanisms of everyday language comprehension in rich, ecologically valid settings.
Upload full text
Use your RU credentials (u/z-number and password) to log in with SURFconext to upload a file for processing by the repository team.