A multilevel and cross-modal approach towards neuronal mechanisms of auditory streaming

Abstract We report first results of a multilevel, cross-modal study on the neuronal mechanisms underlying auditory sequential streaming, with the focus on the impact of visual sequences on perceptually ambiguous tone sequences which can either be perceived as two separate streams or one alternating stream. We combined two psychophysical experiments performed on humans and monkeys with two human brain imaging experiments which allow to obtain complementary information on brain activation with high spatial (fMRI) and high temporal (MEG) resolution. The same acoustic paradigm based on the pairing of tone sequences with visual stimuli was used in all human studies and, in an adapted version, in the psychophysical study on monkeys. Our multilevel approach provides experimental evidence that the pairing of auditory and visual stimuli can reliably introduce a bias towards either an integrated or a segregated perception of ambiguous sequences. Thus, comparable to an explicit instruction, this approach can be used to control the subject's perceptual organization of an ambiguous sound sequence without the need for the subject to directly report it. This finding is of particular importance for animal studies because it allows to compare electrophysiological responses of auditory cortex neurons to the same acoustic stimulus sequence eliciting either a segregated or integrated percept.