Research Of V2X Warning Information Display Algorithm And System Implementation Based On Augmented Reality

Augmented reality technology and V2 X early warning technology are two hot research topics of new technologies.At present,the augmented reality display technology has been integrated into the Head Up Display of cars to give safety warnings to drivers,which to some extent improves drivers’ driving environment safety and driving experience.This paper aims to design and implement a new type of portable device that can comprehensively provide V2 X warning function to drivers by using augmented reality glasses to realize V2 X warning function.By receiving V2 X warning information and analyzing the driving scenes in the glasses,including 3D space recognition,point cloud configuration,camera calibration and custom rendering pipeline design,3D ICONS corresponding to various V2 X scenes are designed in advance to display the V2 X information in the augmented reality glasses.We used THE RGB-D camera to carry out point cloud registration and 3D reconstruction of the scene under the view area in every frame.Then,coordinate transformation was carried out for the position of warning information from V2 X and corresponding warning icons were displayed in AR glasses.In the point cloud registration phase,we consider the noise model to make the camera pose solution more robust.In 3d environment reconstruction,we separate the static bac kground from the scene,so as to obtain the 3D reconstruction model of the static environment and reduce the complexity of dynamic reconstruction.Camera calibration phase through the static version and dynamic version of the combination of calibration mode,extended to multi-camera calibration mode,to achieve more accurate icon positioning function.Custom rendering pipeline design eliminates other redundant rendering techniques mainly considering the depth of field rendering design in order to reduce the amount of operation and improve the speed of operation.Through a comprehensive comparison of the computing power and portability of augmented reality glasses on the market at present,Microsoft HoloLens2 is selected for the test and the final system implementation.The results show that HoloLens2 can accurately locate the warning icon and realize the V2 X warning function after reducing the complexity of dynamic reconstruction and realizing the design of camera calibration and customized rendering pipeline.