The Effect Of Natural Scenes And Body Movements On Micro-expression Recognition

Micro-expressions refer to expressions that are especially short in time,usually lasting for 1/25-1/5s,expressing people’s repressed emotions.Different emotional types have different difficulty in recognizing micro-expressions,and different groups have different ability of recognizing micro-expressions.The research of micro-expression is an important aspect of emotional research.There are already established microexpression recognition and training tools abroad.The research of micro-expression in various fields has also made abundant achievements,but the research of microexpression in China is seldom involved.Referring to the research paradigm of microexpression recognition abroad,this study considers the background emotional factors of micro-expression recognition from the perspective of ecology.The body movements and natural scenes that can express neutral,anger,aversion,fear and sadness expressions are selected as background expressions,and the micro-expressions of anger,aversion,fear and sadness expressions are selected as target expressions to investigate the recognition of micro-expressions under ecological conditions.This study included three experiments using JACBART paradigm.In experiment1,16 kinds of cross-sections were formed by the combination of body movements and face pictures,in order to explore the effect of body movements on micro-expression recognition.The experiment was designed in 4 *4 subjects.In the second experiment,the materials and factors of the experiment were replaced,the combination of natural scenes and facial expressions was used,and task instructions were controlled to explore the effects of different natural scenes on micro-expression recognition.Experiment 3manipulated the combination of natural scenes with body movements and faces,aiming at discussing the recognition of micro-expressions under relatively complete ecology.Under the conditions of this study,the following conclusions can be drawn:(1)Different emotional backgrounds play different roles in recognizing different micro-expressions.It can not be generalized that emotional backgrounds promote or impair the recognition of micro-expressions.(2)Natural scenes can affect the recognition of micro-expressions.When the emotions of scenes are identical with faces,the recognition accuracy is significantly different from that of in-consistent scenes.(3)Body movements can affect the recognition of micro-expressions.When body movements are consistent with faces,there is a significant difference between the recognition accuracy and in-consistency.(4)Body movements can interfere with the recognition of micro-expressions in natural scenes.That is,when body movements are consistent with micro-expressions,the recognition accuracy will be significantly different from that when they are inconsistent,and the recognition accuracy is higher than that when the whole is consistent.