Spatial misregistration of virtual human audio: Implications of the precedence effect

David M. Krum, Evan A. Suma, Mark Bolas

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Virtual humans are often presented as mixed reality characters projected onto screens that are blended into a physical setting. Stereo loudspeakers to the left and right of the screen are typically used for virtual human audio. Unfortunately, stereo loudspeakers can produce an effect known as precedence, which causes users standing close to a particular loudspeaker to perceive a collapse of the stereo sound to that singular loudspeaker. We studied if this effect might degrade the presentation of a virtual character, or if this would be prevented by the ventriloquism effect. Our results demonstrate that from viewing distances common to virtual human scenarios, a movement equivalent to a single stride can induce a stereo collapse, creating conflicting perceived locations of the virtual human's voice. Users also expressed a preference for a sound source collocated with the virtual human's mouth rather than a stereo pair. These results provide several design implications for virtual human display systems.

Original languageEnglish (US)
Title of host publicationIntelligent Virtual Agents - 12th International Conference, IVA 2012, Proceedings
Pages139-145
Number of pages7
DOIs
StatePublished - Oct 22 2012
Externally publishedYes
Event12th International Conference on Intelligent Virtual Agents, IVA 2012 - Santa Cruz, CA, United States
Duration: Sep 12 2012Sep 14 2012

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7502 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other12th International Conference on Intelligent Virtual Agents, IVA 2012
CountryUnited States
CitySanta Cruz, CA
Period9/12/129/14/12

Keywords

  • mixed reality
  • precedence effect
  • spatial sound
  • stereo audio
  • ventriloquism effect
  • virtual human audio

Fingerprint Dive into the research topics of 'Spatial misregistration of virtual human audio: Implications of the precedence effect'. Together they form a unique fingerprint.

Cite this