Research On Limb Motor Function Recovery Of Auxiliary Game Base On Multimodal Learning

In recent years, researches on multimodal learning in Cognitive psychology emerge in endlessly, people using this way to study can always get good results. At present, due to trauma or diseases of the body movement function obstacle seriously affected people’s normal life, rehabilitation training can help patients to improve motor function, reduce the morbidity of patients and improve their lives.Rehabilitation training of action learning needs therapist one-on-one instruction, but the lack of current rehabilitation therapists, treatment sites and other resources, can not meet the needs of patients. The development of the motion-sensing technology,make it possible to achieve the action of the multimodal learning. So this article explore a way of rehabilitation training action learning, improving people’s action learning ability on autonomous learning and the effect.This article is based on the understanding of action study way of limb motor function recovery and rehabilitation training. Firstly, carrying on the deep exploration on information processing mode of the visual, auditory and kinesthetic channels, analyzing the characteristics of each channel on physical structure,information processing and information elements. Basing on computer multimodal researches, theories of multimodal learning, theory of mirror neurons and feedback theory, constructs the model of action learning based on multimodal learning, the model for the action of feedback multimodal study laid a theoretical basis for system design. Then according to the study of information processing way and in the model design, completed the action information in the visual, auditory and kinesthetic channels of information design, in order to achieve the kinesthetic channels of information, using Kinect combining action matching algorithm to design a standard action posture library. Combine the action of each channel by using Unity 3d realized based on Kinect auxiliary game called limb movement function recovery. Finally using the usability testing method to evaluate the usability of the game, adopt the method of comparative analysis to evaluate the learning effect of movements.Through the experiments to prove the game availability is good, the way is better than book in learning effect.To sum up, this paper explore a kind of multi-channel feedback action study way, which can lift the ability of autonomic learning in motor learning and learning efficiency, improve the effect of action learning and fun. According to the action learning model based on multimodal learning, generality in the field of motor learning,can be used as the theoretical basis of action learning material design. The use of the medium for the effect of health education will be better, more conducive to the spread of health knowledge, thus has significant humanistic value.