Facial Expression Modulate Auditory Gaze Cue Effect:the Evidence From Behavioral And ERP

Gaze orienting effect(GOE)refers to the processing of an individual's target to the eye's gaze position is better than the non-gaze position target stimuli.Previous studies on GOE focused on the visual information processing,we call this visual-GOE.Recent studies have shown that the cueing eye gaze also affects the processing of auditory information(auditory-GOE).Facial expression and eye gaze are two important dynamic information in face information.It was generally believed that facial expression would affect the visual gaze effect.However,it is unclear whether the auditory-GOE is modulated by emotion.We designed two studies and four experiments,using behavioral and event-related potential techniques to solve the above problems.Discuss it.The goal is to solve two problems: 1)to explore whether facial expressions will affect the auditory-GOE,and to explore the key factors that produce auditory-GOE;2)if the auditory gaze effect is affected by facial expressions,then this effect occurs in the early perception stage orl the late decision stage.Study 1: Using the improved auditory gaze paradigm,allowing the subject to determine the location of the white noise source.Eye gaze and facial expression information are presented in a dynamic manner by sequentially presenting static face images of emotion.Study 2: Using event-related potential technique(ERP),investigate 1)The effect of eye gaze direction on sound target stimulation occurs in the early perception stage of the auditory processing or in the late decision stage;2)The effect of facial expression on the auditory gaze cue on the time course.The results showed that: 1)The orientation judgement of sound was influenced by gaze direction in all three experiments,and the orientation judgement of sound was faster when the face was oriented to the target location(congruent trials)than when the face was oriented away from the target location(incongruent trials)These findings indicate that auditory-GOE as a social phenomenon exists widely;2)The modulation of emotion on auditory-GOE was observed only when gaze shifted followed by facial expression(Exp3).Gaze shift before the presentation of emotion was the key influencing factor for the emotional modulation in an auditory target gaze-orienting task.3)When gaze shifted followed by facial expression,the individual's eye gaze can affect the auditory cues at 100 ms,and the influence of the gaze onthe auditory target occurred in the early stages of perception.The integration of gaze and expression cues occurs early stage.