Effects Of Audio-visual Interaction On Facial Expressions In Urban Open Spaces

The audiovisual environment is an important part of the sustainable development of urban open space.Facial Expression Recognition(FER),as one of the emerging topics in computer vision and image processing,has been aligned with research in multiple fields as a method of reflecting the psychological state changes of subjects under certain stimuli.Therefore,how to use facial expressions to collect audio-visual perception of human perception has important scientific value.In this study,first of all,through the collection of the typical public space audio-visual environment in the city,laboratory reproduction and testing,recording the subject's facial expression changes under the stimulation of the city's open space,and introducing facial expression recognition(FER)software.The results of the facial expression analysis experiment are compared with the traditional semantic index conversion data to obtain the index that can predict the semantic evaluation result in FER.Under the influence of different types of sound sources in the experiment,the subjects' facial expressions produced different trends,thus verifying the feasibility of FER laying the study of urban open space soundscape.The study found that mechanical sounds have a negative effect on facial expressions,natural sounds have a positive effect on facial expressions,and human sounds have both positive and negative effects on subjects,which are related to the social attributes of the subjects.Different sound sources have different indicators for the main impact.In most cases,the effect of sound sources on facial expression indicators is consistent with the potency.Gender and other social attributes have an impact on most indicators of the three urban open spaces.The type of sound source has a significant effect on the valence of facial expressions and certain indicators.The most influential indicators on the whole are "happy","sad" and "surprise".The study found that changes in the visual environment also affect the valence and indicators of facial expressions.In the open space of the main body of mechanical sounds,the increase in the proportion of green plants has a positive effect on facial expressions.In open spaces where natural sounds are dominant,visual The positive effect of the improvement of environmental vitality on facial expressions is more obvious.In the open space dominated by human voices,natural elements in the visual environment have a positive effect on facial expressions.The research results of this paper can provide a reference for the researchers to evaluate the urban open space audiovisual environment.The interaction of sound and audiovisual effects on facial expressions can guide planners and landscape architects to design urban open spaces.