The Application Of Audio Interaction In The Field Of New Media Art

New media art refers to artworks created with new media technologies,within which interactivity is one of the most significant characteristics.Taking interactive electronic music and games as examples,this paper trys to generalize the principles of sound interaction through the analysis of the logical relations between sound and its mapped objects(ie.motions and images).As a relatively new area of research,this paper engages with various aspects regarding the design of sound interaction in linear and non-linear works,comprehensively addressing the concepts,considerations,approaches and technologies of sound interaction.Interactive electronic music and game,as important members of new media art,employ technologies to engage with various art forms,showing unique and ingenious effects.Unlike traditional sound works which are created mainly by composers and focus on the study of timbre and combinations of notes,sound design in the field of new media art must take into account the interaction between sound and other elements in the works,such as the interaction between sound and body in interactive electronic music and that between sound and player's experiences in games.This interactive relation is crucial to the whole work,as it affects the relations between sound and its interacted objects as well as that between people and the work.The interactivity of sound also enables the audience to participate in the creation of work,breaking the conventional process of music composition and expression.The sequential "composition-performance" relation has gradually begun to transform into a more inclusive and interactive way of generation.The composer has become not only an arranger of notes but also a creator of rules;and the audience is no longer just a listener,but also an interactor or even a performer.In chapter 1 and 2,through the analysis of the expressive features of sound,the logic of sound interaction design and its underlying technologies in the two typical cases,this paper aims to investigate the application of sound interaction in new media art.Based on the understanding and study of sound interaction design and its technological means,chapter 3elaborates on the application of such principle and means in my own installation.