Measurement And Evaluation System Of Finger Motion Characteristics Of Piano Playing Based On Leap Motion

In recent years,with the continuous improvement of people’s living standards,more and more people hope to cultivate their taste by learning to play the piano.However,many problems such as playing piano skills,low efficiency of independent learning and high cost of one-to-one teaching make many beginners afraid or even give up halfway.By collecting and analyzing the gesture of piano professionals’ hands,the strength and speed of their fingers touching the keys,the piano teaching service platform can be established to help beginners learn the correct key points of piano playing and improve the efficiency of independent learning.In this paper,a complete measurement and evaluation system of the finger motion characteristics of piano playing was finally established,by establishing a 3D measurement environment of the hand based on leap motion,measuring and collecting the motion parameters of the finger touch key,and calibrating and describing the normative motion characteristics.The system can assist beginners and teachers to realize the learning and practice of playing the piano.In this paper,based on the physiological structure of human hands,D-H parameter method was used to establish the kinematics model of human hands.The concept of finger motion deviation Angle was first introduced,and Jacob’s matrix was derived,which laid a foundation for the subsequent motion analysis.Then,based on leap motion3 D space sensor,a 3D hand measurement platform was built,a 3D model of finger touch key was implanted,and the capture of finger touch key motion and data collection of each joint motion feature point were realized by coordinate alignment and other methods.The model is simplified reasonably and the measurement method is reliable.Next,8 piano teachers with different finger lengths were screened,and leap motion was used to measure the key touch movements of their fingers.Then,different fitting modes were selected for data processing under the condition that the confidence interval was 95%,and the Angle change relations between the metacarpoparangeal joint,the proximal joint,the distal joint and the deflection Angle were respectively fitted,so as to establish the adaptive function describing the gesture of finger touch key.The velocity information of finger touching the key is processed by the algorithm of de-noising and integration,and the velocity variation of metacarpophalangeal joint,proximal finger joint,far finger joint and deflection Angle is obtained when touching the key.Using the MIDI keyboard,Absolute value was used to simplify and measure the touch point force of the finger,and combined with the pose and speed of movement,a complete characteristic description of the touch point action of the finger length was established.Finally,BP neural network is used to establish the evaluation system of finger movement in piano playing.The system takes the finger touch key movement parameters such as position,speed and touch key feedback as input neurons,and timbre and finger touch key movement score as output neurons.Then through the training and testing,a good evaluation effect of finger playing evaluation system is established.The measurement and evaluation system of finger movement characteristics in piano playing studied in this paper can not only help beginners to learn independently how to touch keys on the piano,but also help patients with hand disability to realize hand rehabilitation training at the later stage of treatment.