The Effect of Spatial Consistence on Multisensory Integration in a Divided Attention Task
Pages 133 - 137
Abstract
The human brain is the most complex and efficient information processing system in nature. Most of the information obtained by the human brain originates from both the visual and auditory pathways. However, few data was acquired about the relationship between audiovisual interaction and spatial locations of audiovisual stimul. Here, we investigated the multisensory integration of audiovisual stimuli presented on consistency and inconsistency spatial locations. The experiment required the subjects to pay attention to the stimuli of visual and auditory channels and to respond to the target stimulation. Through comparative analysis of experimental results, it has been found that under the condition of divided attention, the multisensory stimuli promoted the response regardless of whether the positions were consistent or not. But the integration effect induced by spatially consistent multisensory stimuli was stronger than that inconsistent.That was to say, the consistency of space affects the multisensory integration. This was of great significance for the development of robotics and human-computer interaction technologies.
References
[1]
Talsma D, Woldorff MG. Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. J Cogn Neurosci.2005;17:1098--1114.
[2]
Talsma D, Doty TJ, Woldorff MG. Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? Cereb Cortex 2007; 17:679--690.
[3]
Lippert M, Logothetis NK, Kayser C. Improvement of visual contrast detection by a simultaneous sound. Brain Res 2007; 1173:102--109.
[4]
Wallace, M.T. et al. Multisensory integration in the superior colliculus of the alert cat. J. Neurophys. 1998, 80, 1006--1010
[5]
Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ., Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res Cogn Brain Res, 2002, 14:115--128.
[6]
Lovelace CT, Stein BE, Wallace MT. An irrelevant light enhances auditory detection in humans: a psychophysical analysis of multisensory integration in stimulus detection. Brain Res Cogn Brain Res 2003; 17:447--453.
[7]
Frassinetti F, Bolognini N, Ladavas E. Enhancement of visual perception by crossmodal visuo-auditory interaction. Exp Brain Res 2002;147:332--343.
[8]
Jinglong Wu, Qi Li, Ou Bai, and Tetsuo Touge, Multisensory interactions elicited by audiovisual stimuli presented peripherally in a visual attention task: a behavioral and event-related potential study in humans. Journal of Clinical Neurophysiology.2009; 26: 407--413.
[9]
Qi Li, Jinglong Wu and Tetsuo Touge, Audiovisual interaction enhances auditory detection in late stage: an event-related potential study. Neuroreport 2010; 21:173--178
[10]
Slutsky DA, Recanzone GH. Temporal and spatial dependency of the ventriloquism effect. Neuroreport 2001; 12:7--10.
[11]
David Alais and David Burr. The ventriloquist effect results from near- optimal bimodal integration. Current Biology, 2004; 14: pp.257--262,
[12]
W. David Hairston, Donald A. Hodges, Jonathan H. Burdette and Mark T. Wallace. Auditory enhancement of visual temporal order judgment. Neuroreport 2006; 17: 791--795.
[13]
Frens MA, Van Opstal AJ, Van der Willigen RF. Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements. Percept Psychophys 1995; 57:802--816.
[14]
Hairston WD, Wallace MT, Vaughan JW, Stein BE, Norris JL, Schirillo JA.Visual localization ability influences cross-modal bias. J Cogn Neurosci2003; 15:20--29.
[15]
Meredith, M.A. On the neuronal basis for multisensory convergence: A brief overview. Cogn. Brain Res. 2002, 14, 31--40
[16]
Carrasco M, Ling S, Read S. Attention alters appearance. Nat Neurosci2004; 7:308--313
[17]
Vidal J, Giard MH, Roux S, Barthelemy C, Bruneau N., Cross-modal processing of auditory-visual stimuli in a no-task paradigm: a topographic event-related potential study. Clin Neurophysiol., 2008, 119: 763--771.
[18]
Vogel EK, Luck SJ. The visual N1 component as an index of a discrimination process. Psychophysiology 2000;37:190--203.
[19]
R.B.Welch and D.H.Warren, Immediate perceptual response to intersensory discrepancy, Psychol. Bull., 88, 638--667, (1980)
[20]
S.Morein-Zamir, S.Soto-Faraco and A. Kingstone, Auditory capture of vision: Examining temporal ventriloquisum, Cognit. Brain Research, 17, 154--163, (2003)
Index Terms
- The Effect of Spatial Consistence on Multisensory Integration in a Divided Attention Task
Recommendations
Multisensory integration and exogenous spatial attention: A time-window-of-integration analysis
Although it is well documented that occurrence of an irrelevant and nonpredictive sound facilitates motor responses to a subsequent target light appearing nearby, the cause of this "exogenous spatial cuing effect" has been under discussion. On the one ...
Selective Attention and Multisensory Integration: Multiple Phases of Effects on the Evoked Brain Activity
We used event-related potentials (ERPs) to evaluate the role of attention in the integration of visual and auditory features of multisensory objects. This was done by contrasting the ERPs to multisensory stimuli (AV) to the sum of the ERPs to the ...
Electrophysiological correlates of stimulus-driven reorienting deficits after interference with right parietal cortex during a spatial attention task: A tms-eeg study
TMS interference over right intraparietal sulcus (IPS) causally disrupts behaviorally and EEG rhythmic correlates of endogenous spatial orienting before visual target presentation [Capotosto, P., Babiloni, C., Romani, G. L., & Corbetta, M. Differential ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2018
166 pages
ISBN:9781450365338
DOI:10.1145/3285996
Copyright © 2018 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
In-Cooperation
- University of Electronic Science and Technology of China: University of Electronic Science and Technology of China
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 October 2018
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ISICDM 2018
ISICDM 2018: The 2nd International Symposium on Image Computing and Digital Medicine 2018
October 13 - 14, 2018
Chengdu, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 64Total Downloads
- Downloads (Last 12 months)3
- Downloads (Last 6 weeks)0
Reflects downloads up to 20 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in