Research On Audio-visual Mutual Control Strategy In Interactive Multimedia Creation

Digital art that combines the frontier interactive technology with various media forms is a trend in the forefront of artistic development.The interactive multimedia works,as an important component part in this field,show a new comprehensive art of integration with interactive technology and multimedia forms,is the embodiment of the era's spirit of innovation.The creative platform which interactive multimedia works relies on is mostly an open programming environment that builds or manages audio-visual content from the most basic level.It makes cross-media creation possible with highly opened and degrees of freedom creative tools that can be used by various fields of artists to achieve a comprehensive artistic creation.The combination of image and music is the most typical form of interactive multimedia works,which shows the characteristics of audio-visual presentation of interactive art.As the creative practice and theoretical research are still in the development stage,theoretical research focusing on audio-visual interactive multimedia works is still very rare,but guidance of theoretical research plays an important role in the aesthetic level.Therefore,for the development of interactive multimedia creation works,it is of great historical significance to promote the development to mature by creating the unique form of audio-visual relationship research,which has important theoretical and application value.This dissertation explores the field of interactive multimedia art,focusing on interacting-control strategy between audio and video.The research is divided into four phrases.The first phrase,sums up the theoretical implementations based on audio-visual theory in film art,gestalt principles of perceptual organization,synesthesia and principles of graphic design.In the second phrase,by combining the conclusions form the first phrase with sound listening mode,sound synthesis technology and the related composition concept in sound art,it reaches four application levels of interacting-control strategy as the periodical conclusions.In the third phrase,analyses and verifies the periodical conclusions by studying multiple different genres and representative interactive multimedia works as cases.In the fourth phrase,while demonstrating how different methods of interacting-control strategy performing in mainstream interactive platforms,it draws the final conclusions with the feasible scheme supplement.The interacting-control strategy has a guiding significance for the cross-media creative activity in the field of modern interactive multimedia art.This dissertation first proposed four application aspects of interacting-control strategy between audio and video in interactive multimedia creation works.They are Macro-figure mutual control,Time-allocation mutual,Spatial-distribution mutual control and Microcosmic-image mutual control.Besides,there are two realization forms:Direct Input and Indirect Integration.The conclusion of this dissertation fills the blanks of audio-visual theory in interactive multimedia art in China,which can play a certain inspiration and reference for the related cross-media creation studies.