Research And Implementation Of Virtual Simulation Of Cooperative Gesture Control Of Coal Mining Scene Based On LeapMotion

The underground coal mining work has the characteristics of narrow working space,poor visual environment,many mechanical equipment and frequent safety accidents.Applying virtual simulation technology to the coal mining industry can not only be used for the training of coal mining equipment,but also have higher authenticity and simplicity,achieve the interactive development of teaching and learning,effectively enhance the training efficiency,save manpower,material resources and time,and combine with coal mining safety The whole production features and industry safety standards,to achieve the safety,visualization and intelligent development of mining.In this paper,based on unity3d virtual development engine,the virtual simulation scene of coal mining production is created;based on the leapmotion body sense controller,through the actual operation of coal mining equipment,the virtual simulation research of cooperative gesture control is carried out,and the gesture interaction mode is designed for gesture recognition;multi-user through the establishment of network connection,each terminal gesture control different coal mining equipment to cooperate to complete the coal mining work,It realizes the real-time interactive roaming of multi person cooperative control in the virtual scene,and keeps the scene state synchronous;improves the training efficiency of coal mining equipment,and improves the safety production efficiency of coal mining.The validity of the collected gesture data is detected by setting the speed threshold.The low-pass filtering method and L2 normal form are used for the frame smoothing preprocessing and data normalization,and the four dimension gesture features are extracted as the gesture recognition feature set.The template matching method is used for the static gesture recognition,and the k-nearest neighbor algorithm is used to complete the gesture feature matching,and the best K is selected through the experiment Value:HMM model is used to realize dynamic gesture model training,and then forward algorithm is used to obtain the matching probability of gesture model and complete dynamic gesture recognition.Multi person and multi terminal cooperative gesture control adopts C/S mode and authorization server scheme,uses RPC remote call mode to realize user's remote control,selects parameter transmission,serialization and deserialization and other methods to complete scene synchronization according to the specific operation of the device,and realizes multi person and multi terminal cooperative gesture control.