Augmented Reality System Based On Range Image With Collision Interaction Between Virtual And Actual Objects

Augmented reality, i.e. the "augmentation" of reality, overlap the virtual information, objects and scenes generated by computers to real environment so as to augment the real world. Augmented reality technology breaks through the restriction of the virtual world, integrates virtual information with real information and makes them interact with one another, realizing specific perception and application purpose. This technology has become one the technologies that drew our attention in the past few years.Key technologies of augmented reality contain 3-D tracking registration technology, virtual and actual reality interaction technology, virtual and actual reality integration technology, etc. This thesis will focus on the virtual and actual reality interaction technology. With regard to the problem that virtual objects and actual objects can not meet and interact with each other in traditional augmented reality system, the thesis puts forward a method to segment depth image and construct a geometry agent for actual objects so as to realize the collision and interaction between virtual objects and real scene.This thesis firstly adopts Kinect and other depth acquisition devices to collect the data of the real scene, including its color image information and depth image information. Then it uses the method of region growing to conduct region segmentation for the depth image with the principle of the normal information and connectivity of the point cloud in the depth image, and on this basis adopts plane identification technology of Gaussian image to recognize the principal plane area in the scene. It it removes other points cloud areas in the principal plane area and conducts integration in order to obtain other principal object areas in the scene. Construct a virtual plane for the recognized principal plane as its geometry agent and construct a bounding box for the segmented object as its geometry agent. Finally overlap these geometry agents on real objects and endow physical properties; then the collision and interaction between virtual objects and real objects can be simulated and realized. Main contributions of the thesis:(1) putting forward a method to realize the augmented reality system of the collision and interaction between virtual and real objects with the help of geometry agents; (2) putting forward an algorithm to conduct effective segmentation for the scenes displayed in depth images with the help of the normal information and region connectivity of the depth images.The experiment results demonstrate that the method adopted in this thesis can realize the effective segmentation of simple scenes as well as virtual and actual reality interaction. Concerning the traditional augmented reality system, the thesis puts forward a simple and efficient method to provide more vivid virtual and actual reality interaction effect. It has some innovative significance and application value for the related research and application fields of augmented reality.