The Research And Implementation Of Human-computer Interactive Module In Video Conference

In traditional video conference system,people use keyboard or mouse to manipulate the system,and it may be inconvenient.However,the video conference system products have improved a lot after years of improvement,and it is more convenient for users to use the system because of the new hardware and the use of Natual User Interface.There is no doubt that new hardware,such as touch screen,stylus and white board,have bring convenience to our life.Kinect sensor is a typical hardware that take the advantages of Natual User Interface,which is a user interface that people can control a system in a more effective way.It would be more convenient to use the video conference system if we could make good use of Kinect.In this paper,we introduce CoolView,a video conference system,and designed a NUI-based human-computer interaction system.The system take the advantages of NUI,and with a Kinect sensor,users can use the video conference system in a more convenient way.Based on joint data and Gesture Recognition Toolkit,along with Kinect SDK,we developed a set of gesture recognition modules at which user can train their own gesture and use it to manipulate the video conference system.Besides,the system takes the advantages of D-BUS,which is a bus makes inter-process communication possible,and accords with the standard of high cohesion and low coupling among modules.Three modules are developed: the training module is based on openFrameworks and Gesture Recognition Toolkit while the recognition module is based on GRT pipeline,and the terminal module is based on D-BUS interface.A series test indicate that the human-computer interaction sub-system satisfies the needs of gesture recognition,and it successfully manipulate the video conference system.Moreover,it has a high probability of success while minimizes time cost.