Emotion Recognition And Application Based On Physiological Signals

Emotions play a very important role in our daily lives.In addition to reflecting people’s current physiological and psychological state,it is also a key factor in determining people’s cognitive process,communication and decision-making ability.With the rapid development of human-computer interaction technology,with the upgrading of computer technology,network technology and radio communication technology,users and developers have also proposed new requirements to interactive experience of various technologies and products,which is more suitable for"People-centered"interaction design principles.In the design process of human-computer interaction,three levels are often considered.The first level is the physical level,that is,the mechanical relationship and operation method between human and machine,corresponding to the hardware equipment in the process of human-computer interaction.The second level is the cognitive level,that is,the information exchange between people and computers,corresponding to the operating system in the process of human-computer interaction.The third level is the emotional level,that is,the communication between people and computers,the interactive experience of people and the degree of computer understanding of people,corresponding to the intelligence and feedback of computer processing systems.Our research focuses on the emotional level.Driven by the principle of“people-centered”,the user’s emotional recognition that can objectively judge the real-time interactive experience has gradually become a hot topic in the field of human-computer interaction.Related research has increasingly become an indispensable research direction in the field of human-computer interaction,and has attracted the attention of more and more researchers and research groups.We explored the field of emotion recognition based on physiological signals,and studied related concepts,materials,tools and methods from the aspects of classification,recognition and application of physiological signals,and proposed the application of our recognition classification algorithm model.We designed the experiment method of physiological signal data extraction,and the experiment of emotional recognition based on physiological signals in interactive equipment was carried out.We construct the emotion recognition model by selecting the optimal physiological signal data type and obtaining the optimal data set.Then we design the relevant interactive software system and wearable device,and the model is feasible,real-time,validation experiments for feedback and parallelism with other sensor data types.This article mainly contains the following contents:(1)We have in-depth understanding and exploration of the development and process of emotional recognition based on physiological signals in recent decades,and the existing research content,including emotion-related research theories and methods of emotion recognition and related experimental design.It has been sorted and summarized,and the existing interactive products with emotion recognition function have been analyzed and borrowed,which laid a solid theoretical foundation for the subsequent research.(2)After we analysis the emotion recognition algorithm research in recent years,based on the previous research,two kinds of emotion classification methods based on convolutional neural network are proposed.One method is that the reference is already achieves good results in other field,and another algorithmic model that improves the particularity of the temporal and spatial characteristics of the needle physiological signal.By comparing with other algorithms and previous research results,both methods have achieved good results and provided some research ideas for the related research.Later,we obtained the best physiological signal type for emotion recognition based on the common dataset through different peripheral physiological combinations,and applied it to the later research.(3)In order to obtain the optimal feature set with the greatest correlation with emotional changes,we designed an emotional wake-up and physiological signal data acquisition experiment based on environmental factors.In terms of emotional induction,we allow participants to produce natural emotional changes in accordance with changes in the interactive environment in a natural interaction state.In terms of the type of signal collected,we selected the types of physiological signals that obtained higher recognition rates in previous studies and the types of auxiliary physiological signals that were added for consideration of subsequent application studies.And we have made a little expansion of the subjective scoring questionnaire form,and converted the traditional specific emotional score into a kind of emotional trend judgment.These experimental designs can also play a certain enlightening role for future related research.Finally,we constructed the emotional judgment model using the physiological signal data obtained from the experiment.(4)We applied the emotional judgment model to the application of interactive software system and interactive wearable device,and used Unity3D as the system construction environment on the computer side,and carried out four application experiments.The two application experiments related to the interactive software system are mainly to verify the feasibility of the proposed emotional judgment model and the function of the software system based on the emotion recognition.Related experiments with interactive wearable devices are primarily to verify parallelism and compatibility between other sensor data and physiological signal data for emotion recognition.The experimental results have basically reached our expected goals,but there is room for improvement in recognition speed and accuracy.These application cases have strong scalability and scalability,and low cost,which can help the future development of practical software and hardware based on emotion recognition.The subject of emotion recognition based on physiological signals and application on interactive devices has a great space for development and could even change the pattern of human-computer interaction in the future,which is a very meaningful.