The Research Of Virtual Driving Critical Technology Based On The Technology Of Multi-view Stereo Display

With the development of the society, virtual driving turned to be one of the mostimportant parts in the driving field. To improve the immersive and realistic of the virtualdriving system, virtual driving technology based on the technology of multi-view stereodisplay and virtual reality was researched. The main research works are listed as: multi-viewstereo display technology, eye-tracking technology and force feedback technology.There will be multiple windows from different viewing angle showing in the screen ofthe virtual driving system using multi-view stereo display technology. And the drivingrealistic becomes stronger by3D glasses in conjunction with3D displayer. The scenery wasgained from different viewing angles by installing multiple virtual cameras in virtualenvironment. The viewports in different viewing angles were all displaying in the mainviewport in the way of setting priority level of viewports. The traditional graphics renderingpipeline was improved by NVIDIA3D Vision technology with DirectX11as image engine,which can make the virtual driving system render the stereo images of right and left eyes.Meanwhile, users can get stereo effect in conjunction with active shutter3D glasses.Eye-tracking technology is defined that virtual driving system judge the gazing directionof users by which the main viewing angle of system is adjusted. The eye images werecollected by image collected devices, and the edge of iris was fitted with related algorithm.Then, the coordinate of the iris’ centre was estimated as the direction of gazing direction ofusers. And the main viewing angle of system was changed according to users gazing direction.The technology controlling the main viewing angle of system by changing gazing direction ofusers was in good agreement with the driving process.The force feedback technology is an important method to increase the realistic ofman-machine interaction in virtual driving system. Based on the technology, the forcedistribution of virtual automobiles can be fed back to users and make users feel personally onthe real scene. The dynamics model of driving motion, for instance going forward, drawingback and turning a corner was built. The driving state in different road conditions wereimitated by Bullet physical engine and the force distribution of virtual automobiles wereanalyzed in various driving state. We used the force feedback steering wheel to feedback the force of the car in virtual environment.In summary, virtual driving technology based on the technology of multi-view stereodisplay was researched in the paper. Virtual driving system was optimized and improved interms of multi-view stereo display, eye-tracking and force feedback, which increase theimmersive and realistic of the virtual driving system.