An Experimental Study On The Interaction Between Hearing And Vision

Vision and hearing are the two main senses we, they belong to different areas of their work. The ear by sound perception of sound; through the eyes of light perception of space, but they are not mutually isolated. In life, we often see a picture to associate a voice of experience, or hear the sound and association with some footage of the feelings, "ears see color, eyes heard", depicted is the eye, ear two between sensory function into each other. The sense of people since it is not completely independent, then through learning another sensual art performance to the professional to explore new way of creation, increase the performance of the work force. The author collected the case of innovation at home and abroad audiovisual interactive aspects, in order to understand the new trend of audio-visual interaction. Then from auditory and visual basic elements of the differences and similarities of the light wave and sound wave analysis, to the fundamental elements of the visual and aural art contrast, such as rhythm, rhythm, color emotion, tries to find the similarities between the two through the analysis and comparison. Through the comparative analysis found that there are similar expressions such as rhythm, rhythm between music and visual art, and color emotion etc..According to the similarity between the two. Based on the analysis of the audio-visual fusion case of works of art, such as mot studios Vivaldi's "four seasons" visual music, and Mondrian's painting "Broadway boogie, through the status quo of the visual, structure, color and pitch and music, rhythm, rhythm, contrast, trying to find the creator of auditory and visual interactive creation technique. The analysis found that mot Studios is the music of the pitch and duration rhythm and visual shape, size, color and other corresponding exchange. Mondriaan, jazz rhythm, etc. the emotional attunement point line surface color picture arrangement.The analysis and summary of previous experience, to explore the new audiovisual interactive expression forms, and the actual application effect. Through the observation of candles found candle flame on acoustic perception is very sensitive, so access to the relevant scientific information confirmed acoustic will indeed have an impact on the flame, and thus for the starting point, explores the audio-visual real-time interactive experiments. In the experiment, it is found that the flame will follow the sound wave to vibrate and play the sound of different rhythm, and the flame will produce different amplitude of vibration. The candles play different rhythm of the music, the flame will produce different swing rhythm, the candle into a transparent glass, through the transparent glass of different patterns will reflects the pattern of different shapes, and subsequently swing and consistent with the rhythm of the music of the dynamic picture. The author has been inspired by the experimental results, and the previous study of auditory elements and visual elements between the interactive features and previous experience, apply for creation, "boundary crossing space" design your website a tableaux interactive promotion video, use the interactive effects of tableaux, using different sound material to create different screen effects, rich information communication and presentation skills, let the audience feel more interesting and better accept the information. Hope that the public can feel the charm of auditory perception and visual sensory interactive, more thinking between the two, and apply it to the design and visual convey design to explore more in the form of expression and the possibility.