A Software Synthesizer Sound Visualization Method Using Virtual Objects To Convey Sound Characteristics

This paper establishes a sound visualization method suitable for software synthesizer and applies it to the design of material sound synthesizer.In the existing researches on sound semantics,researchers have found that the words describing sound contain a large number of words related to texture perception,such as smooth and rough,sharp and blunt.Therefore,this study believes that a new sound visualization method can be explored by using literature research method,inductive deduction method,expert method,acoustic semantic experiment method and semiotic analysis method.The core technical strategy of this method is to transform sound features into material features of virtual objects,so as to achieve the purpose of conveying comprehensive sound features through virtual objects.Sound to Virtual Entity(SVE)method for short.The main research contents completed in this paper are as follows:1)Based on existing research results and sound visualization cases,reasonable assumptions and experiments were made on the synesthetic relationship between sound and material perception.The experiment proves that SVE method can convert the four sound features of pitch(frequency),waveform,decay time and octave overtone into the corresponding material feeling,and the understanding rate after translation is 78%.2)The design methods and development of synthesizer sound visualization are combed and studied to guide related design work.3)The SVE method is used for the sound visualization design of the "material sound"synthesizer.Experiments have proved that compared with the tuning task using the spectrum diagram as visual cue,the visual cue scheme designed based on SVE method can significantly reduce the tuning difficulty of people with zero music base,make the tuning task obtain higher tuning satisfaction with fewer tuning times,and improve the tuning accuracy by nearly 30%.