Recongnition Of Audio-visual Cross Channel Of ERP Research

Visual and auditory are important pathways for human perception. This paper useevent-related potentials technique to explore brain memory processing mechanism of thevisual channel, the auditory channel and the audio-visual cross channel.This study using "learning-recognition" experimental paradigm and Neuroscan64channel EEG recording and analysis systems to log and analysis16students on pairs ofChinese words and pronunciation on recognition stage of brain electrical activity. Eachstudent was carried out four conditions of experiments: single channel visual recognition(visual learning-visual recognition); visual recognition across channel (auditory learning-visual recognition); single channel auditory recognition (auditory learning-auditoryrecognition); auditory recognition across channel (visual learning-auditory recognition).Analysis and compare the main composition of ERP waveform of old/new effects evokedby single channel and cross channel recognition. The results are as follows:N400and late component in410-750ms evoked by single channel visual recognitionand cross channel visual recognition have obviously old/new effects. The performance ofN400old/new effects: single channel visual recognition performance is in F3Fz F4F8ofthe frontal region, the central region, the parietal region and P8T8of the temporal region;cross channel visual recognition perform in the occipital region. The performance of latecomponents old/new effects: single channel visual recognition only have old/new effect in580-750ms, the performance of it is in Fp1of prefrontal region, Cz C4of the centralregion, P7P8T8of the temporal region, the parietal region of and the occipital region;cross channel visual recognition only have old/new effect in410-580ms, the performanceof it is in Cz C4of the central region, P7P8of the temporal region，the parietal region andthe occipital region.Both single channel and cross channel auditory recognition evoked N300and latecomponent, only late components have obviously old/new effects. The performance of latecomponent in410-580ms old/new effects: single channel auditory recognition old/neweffect perform in P3Pz of the parietal region and the O1of occipital region; cross channel auditory recognition old/new effect perform in Cz of the central region, the parietal regionand O2Oz of the occipital region. The performance of late component in580-750ms oldand new effects: single channel auditory recognition old/new effect perform in C3Cz ofthe central region, P7T7of the temporal region, the parietal region and the occipitalregion; cross channel auditory recognition old/new effect perform in Cz C4of the centralregion, the parietal region, T8of the temporal region and the occipital region.The results of this study showed that visual and auditory recognition, single-channeland cross channel recognition have differences in brain areas involved in site and its ERPcomponents, suggesting that the visual channel, auditory channel and audio-visual crosschannels with different mechanisms of memory processing.