The effect of auditory accessory stimuli on picture categorisation; implications for interface design

Abstract

When information is presented in multiple streams, users need to integrate these informational elements into a single experienced unity. Every occurrence in an information stream consists of a number of contingencies like colour, location, loudness and mood. In the process of integration, we suppose that some relevant aspects of the contingent information in the modalities seem to be combined. This because the mind expects these modalities to convey related information. In some situations this integration will take more time than in other situations and it seems relevant to find out when having information in more than one modality can facilitate the interaction and/or when it might even hinder the interaction.