The Research Of The Somatosensory Interaction Based On Computer Vision

As an important branch of virtual reality, virtual reality technology wins universal praise for the characteristics of immersion, interactivity and instantaneity. Compared to other roaming technologies, the virtual roaming technology takes a superior position in regards to its participation and naturalness. It is thereupon that emerging areas such as virtual museums, virtual tours and virtual communities that centers on the technology has received widespread concerns in resent years. However, in terms of information input and identification, it is not natural that traditional input devices are still applied in most present virtual roaming technologies. Furthermore, with respect to the display and output of information, although three-dimensional virtual scene gives a better play of immersion of virtual roaming tech and thus brings users 3D visual experience with verisimilitude and shock on large-scaled exhibitions, the stereoscopic image parallax may be so large that the problem of stereoscopic visual fatigue is caused in the process of virtual roaming. In order to solve the problems abovementioned, a virtual roaming method based on somatosensory interaction technology for stereoprojection circumstances is proposed in this paper. The method, which combines virtual roaming, somatosensory interaction with stereoscopic display, is of great significance for the promotion and innovation of virtual reality technology.To begin with, a somatosensory interaction method based on computer vision is applied to the acquisition of interactive information to solve the problem that traditional means of interaction lack of naturalness. Users can control the roaming in virtual scene with convenience and ease by body movement and hands lifting to control respectively the direction of movement and rotation of the roaming viewpoint. In the acquisition process of interactive information, an improved background subtraction algorithm is used to detect human body in images that are acquired in stereoprojection environment; On the basis of pixel distributing characteristics of frontal human foreground image, a method is proposed to separate the user’s head and trunk area from the foreground image for the location of joint point of the human upper body and the obtainment of the posture information of lifting hands; Computer-based binocular vision technologies are applied to acquire users* location information, and by analysis of the positioning data, this paper designs decision algorithm to obtain the information of body movement. Finally, in accordance with the designed interaction rules, interactive instructions are generated by interactive information and by sending commands the movement of the virtual roaming viewpoint is under control.As to information display and output of virtual roaming, a real-time control method of virtual scene stereoscopic parallax is invented to prevent 3D visual fatigue. In consideration of the production and screening process of the stereoscopic image, the paper designs a 3D parallax control model and devises a parallax control method based on the principle of Panum fusion area. It issues a description of the implementation of virtual roaming viewpoint control and virtual scene stereo display based on OpenGL. The method which real-time control 3D parallax by adjusting photographic base and the distance of view translation is proposed.According to the method abovementioned, this paper designs and implements a somatosensory interaction roaming system for stereoscopic projection environment. Instantaneity and accuracy of the recognition method for interaction information, naturalness of interactive method and effect of the 3D parallax control method in this paper have been evaluated through system tests and questionnaire survey, the result of which has confirmed the validity of the method proposed in this paper.