Hearing gestures, seeing music: Vision influences perceived tone duration

Michael Schutz, Scott Lipscomb

Research output: Contribution to journalArticlepeer-review

108 Scopus citations

Abstract

Percussionists inadvertently use visual information to strategically manipulate audience perception of note duration. Videos of long (L) and short (S) notes performed by a worldrenowned percussionist were separated into visual (Lv, Sv) and auditory (La, Sa) components. Visual components contained only the gesture used to perform the note, auditory components the acoustic note itself. Audio and visual components were then crossed to create realistic musical stimuli. Participants were informed of the mismatch, and asked to rate note duration of these audio-visual pairs based on sound alone. Ratings varied based on visual (Lv versus Sv), but not auditory (La versus Sa) components. Therefore while longer gestures do not make longer notes, longer gestures make longer sounding notes through the integration of sensory information. This finding contradicts previous research showing that audition dominates temporal tasks such as duration judgment.

Original languageEnglish (US)
Pages (from-to)888-897
Number of pages10
JournalPerception
Volume36
Issue number6
DOIs
StatePublished - Aug 3 2007

Fingerprint Dive into the research topics of 'Hearing gestures, seeing music: Vision influences perceived tone duration'. Together they form a unique fingerprint.

Cite this