Research And Practice Of Intelligent Sign Language Learning System Based On Mobile Devices

Communication is an important need of everyone,and hearing disabled people are no exception.However,hearing disabled people can't communicate with healthy people due to hearing loss or impairment.They can only express their thoughts and transmit information through words,pictures or other sign language,among which gesture sign language is the most convenient and the fastest way.Therefore,If we want to communicate with people with hearing disabilities,we must learn their language,sign language.Although some sign language translation devices have emerged on the market,which can help the healthy listeners communicate with the hearing disabled to a certain extent,like the common language,sign language also has local characteristics just as dialects.When sign language with local characteristics is concerned,the accuracy of sign language translation devices on the market will be greatly reduced.Only the standard sign language can make these sign language translation devices play a full role.Therefore,in order to communicate with people with hearing disabilities faster and better,the study of standard sign language is the most fundamental and critical,but there are few products about sign language learning in the market and the quality is uneven.This project focuses on the development of intelligent sign language learning system based on mobile devices.Based on the actual needs of sign language learners,and the basic laws of teaching and learning,relying on the current mobile technology,develop a sign language learning APP with perfect functions.Through the questionnaire survey,we have known about needs of people with hearing disabilities and people with communication needs to learn sign language,obtains the first-hand information,and writes the needs analysis of the research.Through the reference and learning of materials,we can understand the basic situation and related technologies of sign language learning software in the current market,so as to lay a foundation for the research of this topic.The ultimate goal of this project is to design and develop a sign language learning APP based on IOS platform.The APP can not only realize the teaching of sign language vocabulary standard action,but also provide the demonstration of facial expression in the process of sign language,provide the function of testing and feedback for the learning effect of learners,and automatically record the errors in the test of learners So that learners can correct and correct mistakes and improve learning effect.Learners can set the amount,time and scope of the test according to their own learning content,which is convenient for learners to use fragmented time for testing and feedback.