Research And Application Of Augmented Reality Technology Based On Mobile Devices

The core of augmented reality technology is the seamless integration of virtual objects(3D models,video,images,audio and so on)with real scenes,how to make the virtual objects consistent with real scene in time,position and light is the technical difficulty.In recent years,with the continuous improvement of mobile devices in hardware and software,augmented reality technology can be applied to mobile devices.But mobile devices are usually limited by memory,computing power,communication speed,hardware architecture,and so on,how to develop the technology applicable to mobile devices on the basis of original has become a research hotspot in the field of augmented reality.Tracking registration and virtual-real fusion are two core modules of augmented reality systems,which guarantee the accuracy and authenticity of the fusion effect.Aiming at the problems related to the realization of these two modules on mobile devices,the following technical research and innovation work were carried out in this paper.First of all,in-depth study of common techniques for tracking registration was carried out.The tracking and registration technology based on natural features was used to recognize and track the target in the mobile device.The method used in this paper does not need to carry out the feature extraction and training,and does not need to repeat the rendering of the virtual object.It solves the problem that the real-time,stability and accuracy cannot be balanced when the single technology is used for tracking and registration.Secondly,based on the research of illumination theory and traditional illumination estimation technology,an illumination estimation framework based on mobile devices was proposed.This framework does not require additional auxiliary equipment,nor does it require complex image processing.The light intensity value in real environment can be obtained in real time through the built-in light sensor of the mobile device.The azimuth angle of the light source can be estimated by using the grayscale statistics of the target texture image block.Adjusting the parameters of the virtual light source based on the values obtained from this framework can enhance the sense of reality of the virtual objects in the fusion scene.Finally,combined with the current research results and market research,using the tools of Unity,Android Studio and other tools,a mobile augmented reality application based on Android platform for interactive children's interesting learning was developed.This application not only completes the basic work in augmented reality application,but also has interactive preschool education function.After releasing the application to mobile devices,some performance tests are carried out to validate the research results.