Similarities And Differences Of Neural Mechanisms Of Emotion Perception In Visual And Auditory Channels

Emotion is a rapidly changing psychological and physical phenomenon.It reflects the body's adaptation to the changing environment.In daily life,people need to use the information of various sensory channels(such as visual information,auditory information,etc.)to perceive non-verbal emotional information.Non-verbal emotions from faces and sounds are often complex and varied.Similar expressions or sounds may represent completely different emotions.Failure to perceive and understand these non-verbal emotion signals often results in communication problems.Previous studies have often thought that the brain has separate brain regions and networks that deal exclusively with information from faces and voices.The perception mechanism of the emotions of the faces and sounds has also been researched.In contrast,The similarities and differences of the emotional perception mechanism between the different sensory channels(such as visual and auditory)have not been well studied.Research on audiovisual integration explores the neural basis for the processing of emotional information across cross-channels,but the multisensory cortex of sentiment perception from the visual and auditory channels has not yet been clearly studied.It is still controversial whether a single sensory cortex,which is a lower-level,traditional sense,is treated uniformly by receiving information from a single,low-level sensory cortex,or this brain area is from the advanced multisensory cortex.In addition,whether this multiple sensory cortex distinguishes different types of emotions has not been clearly studied.Therefore,it is very necessary for us to study the similarities and differences between the neural mechanisms of emotional perception under visual channels and auditory channels.The purpose of this study is to explore the similarities and differences of the neural mechanisms of visual emotion perception and auditory sensory perception,and to explore the multiple sensory cortex of cross-channel emotional perception.Inorder to achieve the above objectives,this study designs 2*3(stimulation presentation channel types: visual,auditory;emotion type: happy,sad,fear)event-related tasks.The state-of-function task MRI task recorded the value of the blood oxygen signal(BOLD signal value)in the process of emotional perception caused by the stimuli of the visual channel and auditory channel,and explored the participants' perceptions from different sensory channels.The different types of emotional information perceive the similarities and differences of brain activation intensity and decoding mechanisms,find multiple sensory cortices of the emotional perception of the visual and auditory channels,and provide valuable imaging for the emotional perception and neural mechanisms of visual channels and auditory channels.The experimental task can be divided into two parts.The first part is the positioning of each subject's area of ??interest(low-level visual cortex: V1-V4;face selection area: bilateral FFA,bilateral STS;auditory cortex: AC).The second part is the collection of brain information when each participant perceives emotional information from different sensory channels.The research scope of this study is the neural mechanism of emotional perception of the visual channel and the auditory channel,so the experimental materials involved pictures of faces with happiness,sadness and fear,and audio sounds of happiness,sadness and fear.In the first study,we study the activation intensity and activation pattern of a region of interest.The results of activation intensity showed that the activation intensity of emotional face in V1-V4,bilateral FFA and bilateral STS was significantly higher than that of emotional sound.The activation intensity of AC on emotional sound was significantly higher than that of emotional face.Immediately,the multivoxel pattern analysis(MVPA)results showed that the activation pattern of the right STS was sufficient to distinguish the happy faces,sad faces,or fearful faces.The activation pattern of the FFA on the right can distinguish whether the stimulus is happy face or sad face.Interestingly,the results of this study showed that AC's accuracy in distinguishing happy,sad and fearful emotions on both channels also reached a marginal(P=0.02,uncorrected).In the second study,the whole brain search analysis showed that the main effects of the emotional type were significant and reflected in the left pars opercularis gyri frontalis inferioris.The interaction effects of emotion type and sensory channel type were reflected in five brain regions:right precuneus,left dorsolateral superior frontal gyrus,The predominant anterior cleat,right superior parietal lobule,left medial superior frontal gyrus,the result aisoexhibited significant effects on the type of sensory pathways and corroborated with the activation intensity results.After this,this study also calculated the differences in the activation intensity of the emotional type main effect region of interest for the six stimulus conditions.The results showed that the intensity of activation of the fear face was significantly higher than that of the fear sound;the intensity of the activation of the fear face was significant Higher than of the sad face;the intensity of the activation of the fear face is significantly higher than that of happy face;the intensity of the activation of the fear sound is significantly higher than that of happy sound.In summary,this study can draw the following conclusions: First,the low-level visual cortex(V1-V4)and the face selection area(both bilateral FFA and bilateral STS)have stronger activation of emotional faces,and temporal lobe auditory Cortical activation of emotional sound is stronger,that is,the above-mentioned region of interest exhibits a difference in the activation intensity of the emotional perception of visual channels and auditory channels.The second and the right STS played an important role in the perception of happy faces,sad faces and fear faces.The right FFA played an important role in the perception of happy faces and sad faces.Third,the activation pattern of the temporal lobe auditory area also shows its tendency as a multisensory cortex of cross-channel emotion perception.Fourth,the left lower forehead island cover may be the multiple sensory cortex of visual-auditory perception,which is the common pathway for visual and auditory emotion perception,and it is most sensitive to negative emotions,especially the fear of the face.Fifth,the right precuneus,left dorsolateral superior frontal gyrus,The predominant anterior cleat,right superior parietal lobule,left medial superior frontal gyrus have important contributions to the emotional perception of the visual and auditory channels.