How does visual information affect the way we perceive sounds? What are the musical implications for such findings? Intrigued that visual information can play a role in music, I video-recorded a world renowned percussionist playing single notes using different types of gestures. Perceptual research demonstrates that although different gestures did not effect the acoustic information produced by the performer, they did effect the perception of this information. Essentially, this represents a real life musical illusion, used for many years by the world's leading percussionists. After publishing this work in Perception (2007), I have gone on to further study this illusion. Because of my interest in this topic, I was recently invited by Bill Thompson (President of the Society for Music Perception and Cognition) to write a review article on the subject, which is now published. For reprints of relevant papers, please see my publications page as well as my manuscripts currently under review. On April 29th, 2009 I successfully defended my dissertation Crossmodal Integration: The search for unity at the University of Virginia. This series of four experiments demonstrates that tone envelope is a crucial cue for cross-modal integration, and is available for download (stimuli will be posted at a later date). View the press popular press version of a paper presented at the 153rd Acoustical Society of America convention. Published papers on this work: Schutz, M. & Kubovy, M. (2009). Deconstructing a musical illusion Canadian Acoustics [invited submission]. Schutz, M. & Kubovy, M. (in press). Causality and cross-modal integration. Journal of Experimental Psychology: Human Perception & Performance. Schutz, M. and Lipscomb, S. (2007). Hearing gestures, seeing music - vision influences perceived tone duration. Perception 36 (6), 888 – 897. Papers on this work currently under review: Armontrout, Schutz, & Kubovy. Causality, duration, and cross modal integration: Exploring the Schutz-Lipscomb illusion |
|
Research >
Sensory integration |