CyberGlove Based Interactive Manipulation In NC Simulation System

The human computer interaction of traditional numerical control machine tool simulation system by using mouse, this interaction mode look the user and the computer as two separate parts, user interface as a medium to exchange information, instructions are input to the simulation system by user and explain by the parser then make machine move. The sense of immersion and interactivity are very poor by use mouse and keyboard, which can’t give the trainers a real sense of experience and can’t achieve the goal of training when they operate the machine.In order to solve the problems of above, this paper offer a solution using virtual reality technology to enhance the sense of immersion and interaction of NC simulation system. In the solution, we use data glove and magnetic track to achieve human-computer interaction module to simulate the process of operation machine tool. Specific research work as follows:Firstly, study virtual hand modeling. When we operation NC machine tool, virtual hand interaction is a key part of HCI. In this thesis by analysis human hand structure to build human hand skeleton hierarchical model, according to the appearance of the characteristics of human hand, using3DSMax modeling virtual hand model. Finally establish a mapping relationship between data glove and various joints of the virtual hand model. Achieve to use data glove control the movement of virtual hand.Secondly, study gesture recognition based on data glove. In the process of virtual hand operation NC machine tool, using gestures to determine the intention of operation then find which object be manipulated through the collision detection, finally NC machine tool response the operation. By study the CyberGlove SDK, achieve to get the sensors data, finish data glove and magnetic tracker get data module of the simulation system. Using BP neural network algorithm achieve gesture recognition based on data glove.Thirdly, study collision detection algorithm based on XNA Game Studio4.0engine. In order to confirm the operating object in the interaction we need to use collision detection. By study XNA engine, we know the structure of X file, we can create bounding box for each of buttons on virtual operation panel of NC machine tool and each section of virtual hand, achieve collision detection based on bounding box in XNA engine.Fourthly, achieve interaction module. Build three-dimensional environments by XNA engine, using3DSMax and Solidworks as modeling tool, using CyberGlove and Liberty magnetic tracker as input device of interactive platform, using virtual hand as a response object of the platform, to control the motion of virtual hand in environments and establish simulation platform module based on dot net architecture.