Research On Upper Limb Rehabilitation Interaction System With Kinect

In the field of rehabilitation medical, now the main method are manual and robot aided training, artificial auxiliary training is rehabilitation coach one on one to guidance patients of rehabilitation training, but reality often lack of medical resources, robot assisted method have expensive and single intelligent defects. Provide a good recovery effect rehabilitation training system which also can solve the lack of medical resources, low maintenance cost, low cost defect is an important research topic in the field of medical rehabilitation.In order to solve the above problems, this article we studies the interactive system of motion rehabilitation through human computer interaction, motion recognition technology and mobile medical. This system, including rehabilitation patients, rehabilitation coach and doctor three roles, including mobile side, PC side and server side. We use PC side connection Kinect hardware and Unity3D to capture three-dimensional position data of the human upper limb, by controlling the virtual characters to do rehabilitation exercise, in the virtual scene reconstruction patient movements, then connect to the server for human action recognition and evaluation. We realization of exchanging the information between the different roles by the mobile side, achieve information closed-loop and multi terminal cooperative by connect to the server. The main research contents are as follows:1, Doing research on methods of feature extraction:we through the Kinect sensor to obtain human depth map and skeleton information, study the method of measuring joint points of the human body activity, and how to extraction the motion flow feature data, using the Holt exponential smoothing method for Kinect features data pretreatment, to prevent the noise caused by the jitter and jump caused by the distortion of the movement.2, Studying the interactive form of exercise rehabilitation system:we analysis of three roles, design based on the different roles of the authority management system. Design mobile terminal, research functional logic.3, Doing research on action recognition method:we matching action through the improvement of the dynamic time warping algorithm (STDTW), and action evaluation is achieved by using the k-means algorithm, effectively and efficiently achieve rehabilitation training in the key action recognition part. Realize key technology of rehabilitation system through the algorithm which effective and integration.4, Doing research on build the interaction scenarios of system:creation of a virtual character and virtual scene by Unity3D, patient control virtual characters in the rehabilitation process, show action flow reappear in the virtual scene, in the form of a three-dimensional scene to bring some interesting in rehabilitation training, improve training interest and enthusiasm.Experimental results show that using this motion interaction system for upper limb rehabilitation training can achieve the desired effect, at the same time in the form of three-dimensional training can also improve the patients’ enthusiasm.