| People absorbing various information from different senses all the time, in order to complete the different cognitive tasks. By integrating and regulating the information, the brain can guide people’s behavior and thought efficiently. People had done a lot of things to research the brain mechanisms on information integration and cognitive. To draw such a fast and efficient brain information processing model, it can be used in other fields such as Intelligent Systems. As the two important channels of human beings to accept outside information, visual and auditory have arouse widespread attention. Currently, the study of single sensory channel, such as visual, auditory, has achieved many valuable results. However, it also has many key technologies to be solved, for example:the brain cognitive research on visual-auditory audio-visual interaction, information processing method, audio-visual evoked EEG feature extraction and so on.Considering above problems, this paper designed the experimental paradigm of visual-auditory synchronous stimulation, and real-time collected the EEG signal. Studied the evoked EEG’s processing method and the source localization of brain function area. Based on these studies, explored the collaborative action and the crossed interference effect of the brain cognition behaves under the visual-auditory dual channel. The completed work is shown as follows:(1)Based on the Stroop effect, we designed the induced paradigm of cross-sensory joint stimulus. Using 40-lead event-related brain potential instrument on Scan4.5 software platform, synchronous acquisition the visual stimulation, auditory stimulation, and visual-auditory stimulation EEG.(2) In order to get pure evoked EEG, we use independent component analysis, remove the ocular artifacts. Then combine AR model to establish model with do 20 times coherent average method to preprocessing the EEG signals. This method can remove the original EEG’s noise, interference and artifacts effectively(3)Extract features the evoked P300 potential based on wavelet transform in visual stimuli, auditory stimuli and visual-auditory stimuli. And the information integrated function, crossed interference effect and attention rivalry mechanism were depth investigated on the visual and auditory evoked brain cognitive mode.(4)Using sample entropy analysis method, to solve the related leads’ sample entropies and extract the nonlinear characteristics of EEG evoked under the three stimulation modes. By measuring EEG’s complexity, reflected the complexity and coupling features of neurons in the brain activity.(5) Based on Source software platform, use dipole to analysis the EEG data evoked by the visually targeted stimulate, auditory targeted stimulate and the Visual-auditory double target stimulate. Studied the brain function area of single-channel and dual-channel stimulate, meanwhile, analyzed the cross-coupling effects between visual and auditory stimuli and laid the foundation for the construction of brain functional network.The methods and results of this study can be applied to neural information processing, brain cognitive sciences and brain-computer interaction system. It has the double value of science and application. |