The Influence Of Audio-visual Dual Channel Processing On The Attentional Blink Of Chinese

In our daily life,people are always hoping to identify targets as quickly and validly as possible.While because of the limitation of humans' attention,we cannot always do it like that.When two targets are presented among distractors in the rapid serial visual presentation(RS VP),correct identification of the first target may results in a deficit for a second target with 200-500ms.Raymond(1992)named this phenomenon as attentional blink(AB).Chinese characters is a multi-channel processing of hieroglyphs,every Chinese character is an amalgam of figural righteousness,it'5 processing different from English letters,through perception,memory channel processing.In addition,in the language environment of Chinese characters,it has the vital significance of fast rendering recognition on people's learning,life and work.So,it it becomes our main purpose to explore whether using Chinese characters of the graphic,phonological and semantic,and has nothing to do with Chinese characters as T1 and T2 can influence the attentional blink or not.Most of the previous studies have discussed attentional blink in RSVP using visual single-channel,while the present study may use visual single-channel and audio-visual dual-channel RSVP two paradigms to examine the attentional blink effect elicited by the graphic,phonological and semantic Chinese characters step by step.The audio-visual dual-channel RSVP manipulates the audio-visual stimulation are related to each other through three conditions of audio-visual related,audio-visual non-related and silent,it may test whether the attentional blink effect elicited by the graphic,phonological and semantic Chinese characters is regulated by audio-visual dual-channel processing.Also,we can investigate the feature of attention entirely through time and two channels of visual and auditory.The current study described the attentional blink effect elicited by the graphic,phonological and semantic Chinese characters through two parts of experiments,using ERP technique which has high time resolution ratio.To analysis the pure ERPs evoked by T2,the subtracting technique was used to eliminate the overlapping resulted from rapid visual presentation.Experiment 1 was about the attentional blink effect elicited by the graphic,phonological and semantic Chinese characters in the classic RSVP task.It included two branch experiments,the pure behavior experiment and using ERP technology as an assistive technology,with a view to state that the graphic,phonological and semant:ic Chinese characters would effect the attentional blink.Experiment 2 was about the attentional blink audio-visual dual-channel processing elicited by the graphic,phonological and semantic Chinese characters.It also included two branch experiments,sound-previously with T2(T2-1)and sound-simultaneously with T2,with the purpose to discuss whether the attentional blink was regulated by these sound conditions.In the experiment 1,the results showed that the graphic,phonological and semantic Chinese characters are produced significant attentional blink,the graphic Chinese character can evoke the most significant attentional blink.Compared with phonological Chinese character,the semantic produced the obvious attentional blink.There is not significant between the phonological and the non-related Chinese character.And the ERP data shows that there is not significant of the early perceptual processing P2 amplitude between the period inside and outside AB.Compared with the period of outside AB,during the period of AB evoked a higher N2 amplitude and lower P300 amplitude.The graphic Chinese character evoked the most lower P300 amplitude.It indicated that AB was inhibition in the early attention period of N2 and continues to the P300 stage.In the experiment 2,in the dual-channel RSVP paradigm,added sound stimuli can affect the Attentional Blink effect.Mainly for the sound-previously condition,sound related T2 recognition correct rate was significantly higher than the sound non-related,silent T2 recognition correct rate,under the condition of lag2 sound related T2 identification correct rate was significantly higher than that of the silent T2 correct recognition rate,sound non-related T2 identification correct rate was significantly lower than that of the silent T2 correct recognition rate,that in transient tardiness sounds related to the attentional blink effect weakened voice independent will strengthen the attentional blink effect.ERP results showed that P2,N2,P300 and ERP N400 components all showed the main effect of the type of sound.Silent T2 than the sound non-related T2 evoked greater P300 amplitude,sound related to T2 than the sound is not related to the T2 also induced a greater P300 amplitude,which shows that the recognition of the sound independent T2 has been suppressed.In the sound-simultaneously conditions,behavior results showed that the main effect of sound condition is not significant.But in lag2,the sound-related T2 recognition rate was significantly higher than the recognition rate of silent T2.the results of ERP showed that T2 was sound related and sound non-related associated with silent T2 induced greater P2 amplitude,it reveals that early perceptual processing of dual channel reflects the preferred choice in attentional blink.Silent T2 than sound non-related T2 induced the greater P300 amplitude and sound related T2 than sound independent T2 also evoked a larger P300 amplitude,and silent T2 evoked P300 amplitude and sound related T2 evoked P300 amplitude difference was not significant,which suggested that shows that the recognition of the sound independent T2 has been suppressed,and sound non-related is the trend of strengthen the attentional blink.In sum,this paper makes a the following conclusions:(1)Chinese characters of graphic,phonological and semantic related T2 impacts Attentional Blink effect.Compared with non-related Chinese characters,graphic of T2 is the most significantly impacted attentional blink,followed by semantic related T2,the phonological related T2 minimum.(2)In the dual-channel processing,Attentional Blink will be reduced by the sound-related T2,and exacerbated by the sound independent T2,like the Chinese character attentional blink degrees off the most obvious changes.(3)Sound related and unrelated to the N400 evoked the additional semantic processing affects the attentional blink effects,sound of join activated the new attention resources can leads to the increase of the amplitude of the P300,weaken the effect of attentional blink,sound unrelated reduces the P300 amplitude,exacerbating the attentional blink effect.