Real-time Generation Method Of AR Scene For Virtual Experiment In Middle School

As a new experimental teaching method,augmented reality virtual experiment is very helpful to carry out some experiments with certain risks.Moreover,for some experiments with insignificant experimental phenomena,augmented reality technology can significantly improve the experimental phenomena and improve the learning effect of students.In the augmented reality environment,students can perform actual operation on the experimental equipment and achieve instant feedback of WYSIWYG.However,the operation process of the augmented reality system involves more complex algorithm such as 3D registration and graphics rendering.The processing capacity of the equipment in the middle school classroom teaching environment cannot meet the demand of real-time interaction.Therefore,this paper carried out the research on the real-time generation method of AR scene for middle school virtual experiment.The main research contents are as follows:(1)An augmented reality scene generation method based on cloud environment is proposed.The original process of augmented reality scenes generating for virtual experiments is decomposed into three part:environment understanding,three-dimensional registration and augmented reality overlay rendering,and the specific implementation framework and workflow are given.(2)In terms of target recognition,a distributed target recognition algorithm that uses the Kalman filter and human hand motion constraints during the interaction to estimate the user's hand position was designed.Based on the result,the interest area of target recognition is divided,which accelerates the process of target recognition and improves the recognition rate of experimental equipment.the reference image which is most similar to the current view image is obtained by template matching,and its corresponding pose is obtained.Then,the accurate posture of the camera is precisely estimated by interpolation calculation.Through the physical constraints of the experimental equipment and prior knowledge of the experimental conditions,we amended the 3D registration results to obtain a reasonable environment understanding result,and used the geometric model consistent with the shape and size of the real object as the virtual mask layer to remove the virtual and real occlusion.(3)In terms of virtual-real fusion rendering,the 3D registration results are modified to achieve the correct virtual real scene matching through the physical constraints of the experimental equipment and the prior knowledge of the experimental conditions.An occlusion method based on twin digital model is designed,and the accurate virtual real occlusion is eliminated through depth calculation.A distributed rendering method based on object distribution are proposed.The virtual objects are divided into several groups according to the spatial distribution to realize the parallel processing of rendering process and reduce the time cost of scene rendering process.(4)A middle school augmented reality experiment prototype system is designed to verifies the generation method of augmented reality scene in the cloud environment.Through an actual middle school experimental case,the correctness and applicability of the research results are verified.