The Study Of Speech Visualization

Language is the most natural and direct way of communication between each other,and it is the most effective form,especially in communicating ideas and feelings.However,for some hearing impaired patients,especially congenital and children patients,they cannot chat with normal people,because they cannot hear anything.Even though there exist some electric assistant system equipment and hand language,most of them are not suitable.And these hearing impaired patients will feel lonely with time goes by.So,this thesis use the technology of speech visualization to design a hearing compensation system for all the patients,especially congenital and children patients.With the system,they can "see" the speech with their eyes,which are totally healthy,and then know what the speech says.Thinking about the situation that congenital and children patients' learning ability is weaker than normal people,they cannot learn the enormous amounts of Chinese characters,this thesis use initials and vowels,which are fewer and easy to learn to take the place of Chinese characters.And use color coding technique to appear more speech details,such as speaker's emotion,volume and rhythm,etc.The job of this thesis can be divided into four parts:(1)Build a system to cut a syllable into initial and vowel.Without few syllables,all the syllables are made up by initial and vowel.So,before using initials and vowels to speech recognition,this thesis use subject-extension pitch detection to extract initial and vowel.(2)Design a speech recognition system using initial and vowel.First,this thesis introduces a technology called initial preliminary election to improve accuracy of initial recognition.Then employs a improved DTW algorithm to recognize initial and vowel.And after certification,this improved algorithm can reach experimental requirements.(3)Employ color coding technique.Language communication not only includes verbal content,it also has some speech details.This thesis uses color coding technique,different initials and vowels are transformed into different colors.So the patients can read the color to know the content and acquire speech details with seeing the shape of the colors.(4)Design a hearing compensation system based on MATLAB.Through experiments,the system runs well and achieves the design goals.