Synchronously Matching Of Visual And Haptic Scene In Three-dimensional Space For Virtual Reality

Virtual Reality technology has been widely used in military, engineering, medicine, education, et al. The medical application of Virtual Reality at the moment is various and quite adequate to adapt closely with Virtual Reality system. The research of the Virtual Surgery is a cross-discipline of life and information sciences, which is significant to the development of medicine, biology and other human-related subject.At present most systems just have simplex visual stereo or haptic stereo, and cannot read model information with high resolution fleetly, the research of this paper includes: rapid acquisition of Virtual Chinese Male-No.1 3D model data; the construction of the visual model and haptic model; the implementation of matching visual stereo and haptic stereo synchronously in three-dimensional space, and simultaneously rendering of visual and haptic stereo.Faced the technical difficulties in implementing the visual and haptic stereo synchronously, Open Inventor and GHOST are choosed as the development tool through the comparison with wide-used methods. On the one hand, Virtual Chinese Male-No.1 3D models are repaired and compressed for visual model; On the other hand, hierarchical bounding volumes method for collision detection is adopted for haptic stereo model. At last, the visual and haptic scene are matched synchronously to construct the platform interface for simulation platform, which integrates active stereo glasses and haptic device. The simulation platform gives manipulator two stereo model for visual interacting.Based on this simulation platform, the process of muscle injection is simulated through injector which is operated by medical care personal, and a measurement and evaluation are given to the data-obtaining and matching results. The outcome indicates that it is quite quickly in data-obtaining and accurately in 3D matching, and the matching resolution is 0.02mm. The synchronization platform for visual and haptic stereo based on Open Inventor and GHOST supplies a new approach for medical 3D simulation training.