Font Size: a A A

Research On Grammatical Sign Language Teaching Platform

Posted on:2020-02-23Degree:MasterType:Thesis
Country:ChinaCandidate:S W A T B K YiFull Text:PDF
GTID:2415330590954865Subject:Software engineering
Abstract/Summary:PDF Full Text Request
At present,there are a large number of deaf-mute people in the world.Sign language is an indispensable tool for deaf-mute people to acquire knowledge,communicate with others,exchange information and receive education.Sign language,as a special language,has become a bridge between normal people and deaf-mute people to exchange information.To do a good job in sign language teaching and let the deaf learn formal grammar sign language is focus of the deaf school teachers' work and focus of scientific researchers.In addition,it is of great significance to let more listeners learn sign language and promote communication between deaf-mutes and listeners and integrate deaf-mutes into society and promote the promotion of sign language.In order to enable the deaf and mute to learn sign language quickly and relieve the pressure of teachers to translate sign language in class,this paper develops a grammar sign language teaching system based on Chinese textbooks of deaf schools.This system can translate text into sign language that deaf-mute students can understand.In addition,listeners can use this system to learn grammar sign language,helping to promote the effect of sign language.This paper establishes virtual human and realizes the synthesis of sign language animation based on key frame mechanism and skeleton-skin algorithm principle and establishes the Chinese sign language animation library.At the same time,in order to facilitate using of animation library,the animation library is compressed.At last we obtain a usable,appropriate sized sign language animation library.In order to achieve the effect of transition fusion between sign language animations,the intermediate transition frames of two sign language animations are calculated to realize the sequence synthesis algorithm of continuous sign language animation.In order to translate text into sign language,an improved algorithm of stuttering segmentation is used to segment Chinese texts in schools for the deaf.In addition,in order to improve the accuracy of sign language translation,the teaching platform of grammar and sign language realizes the function of processing sentences.Through editing the sentences and words,the accuracy of text translation into grammatical sign language is improved.Meanwhile,the text processing results are transformed into sign language animation according to sign language transcoding table,which is sent to Unity3 D animation module to drive the animation module to synthesize pairs.The corresponding sign language animation sequence realizes the translation function from text to sign language.Compared with the traditional sign language synthesis translation method,the animation synthesis technology adopted in this paper has three distinct advantages.First,the method of sign language synthesis is simple,and there is no need to develop a special animation synthesis engine.Using Unity3 D game engine to synthesize sign language animation has the characteristics of convenience,rapidity and exaggeration platform.Secondly,it is easy to operate and is conducive to promotion.Professional three-dimensional animation software can produce standard sign language animation without the sign language animation data collected by electronic gloves.Thirdly,the accuracy of sign language translation is high.In this system,the function of manual editing sign language words and sentences is provided,and the accuracy of sign language translation is high,which meets the requirements of Chinese teaching in deaf-mute schools.
Keywords/Search Tags:sign language, teaching system, sign dictionary, segmentation of sign words, sign animation, Unity 3D
PDF Full Text Request
Related items