Time Course Of Interaction Between Facial And Body Expressions

Facial expression is one of the main external expression forms of emotion.There are abundant studies on facial expression characteristics,configuration and overall processing.In recent years,it has been found that facial situations have an impact on facial expression recognition.Research on the impact of different channels(vision,hearing,olfaction),different emotional cues and different instruments(ERP,f MRI)on facial recognition has been emerging.In the process of recognizing other people's emotions,we not only rely on the face,but also the body can provide us with emotional information.Decoding social signals from non-verbal cues plays an important role in human social interaction.Because non-verbal emotional signals from face and body often appear together,it is important to study the mechanism of integrating emotional signals from these two sources.So how do the emotional information of different emotional carriers interact and recognize each other? In this study,positive and negative facial and body expressions were selected.Adobe Photoshop CS 6 was used to combine facial and body expressions.The ratio of facial and body expressions was adjusted to approximate 1:7 to make the combined pictures as realistic as possible and close to the real human body ratio.Presentation of separate facial,body and facial-body expressions.The task of subjects is to recognize and judge facial or body expressions,collect reaction time,correct rate and ERP signals.Experiments 1: The reaction time and correct rate of body expression and facial expression recognition were investigated from the perspective of behavior.In this study,a 2(body expression: positive and negative)*2(facial expression: positive and negative)experimental design was used,and then the data were combined into a single factor consistency analysis.Experiment 2: From the perspective of cognitive neuroscience(ERP),the neurological characteristics and time course of body and facial expression recognition were investigated.The experiment was designed with 2(body expression: positive and negative)*2(facial expression: positive and negative)x electrode points.The results are as follows:(1)In the recognition of facial and body expressions presented separately,the main effect of emotional carriers is significant,that is,the recognition of facial expressions is faster than that of body expressions and the accuracy is higher.(2)In recognition of complex facial and body expressions,the accuracy of facial expressions is significantly different;the interaction between facialexpressions and body expressions is significant,that is,there is a significant difference in consistency and inconsistency.When facial expression and body expression are identical(facial positive-body positive,facial negative-body negative),the response time is faster and the accuracy is higher than that of inconsistency(facial negative-body positive,facial positive-body negative).(3)ERP results showed that the body expression on P1 was larger than the facial expression when facial and body expressions were presented separately.Facial expression induced more negative N170 component than body expression,but the latency was prolonged.(4)When recognizing complex facial and body expressions,only the difference of electrodes was significant when judging the face.When judging the body,the interaction between facial expressions and body expressions was significant on N170 and P3.(5)On N2 and P3,the main effect of consistency between facial expression and body expression was significant.And it happened in the early stage of processing.The difference of judgment task was mainly concentrated in the middle and late stages,namely N2 and P3.In summary,the following conclusions can be drawn:(1)Facial expression and body expression interact,and the influence of facial expression on body expression is greater.(2)Body expression is the first concern(emotional vector effect),but it is more dependent on facial expression when making emotional judgment.(2)Early body expressions received first attention(emotional carrier effect),but relied more on facial expressions when making emotional judgments;In the medium term,facial expressions dominate and can distinguish between different emotions,while emotional conflicts are noticed.(3)Facial expressions and body expressions are processed differently.The interaction in the processing process occurs in the early stages,and the facial influence on the body lasts longer.