Research On The Training System Based On MR For Calligraphy And Painting

In recent years,with the large-scale popularization of smart phones,the popularity of VR boxes and the launch of various high-quality VR helmets,the VR industry has ushered in a period of rapid development,and it has also driven the rapid development of MR and AR.VR,MR and AR provide a new platform,many traditional applications can get new life under the new platform,and many applications that were previously difficult to implement can be successfully implemented under the new platform.The thesis mainly explores the application of MR technology in calligraphy and painting.The main work and innovations of the paper are summarized below.The thesis proposed a MR-based painting and calligraphy copying system,which is implemented in an optical transmissive MR helmet and a video perspective MR helmet.Compared with the traditional calligraphy and painting method,the MR-based calligraphy and painting system directly displays the virtual signature/poster on the table.There is no need to cover the copybook on the copybook.There is no occlusion problem,so you can not only copy the traditional thick ink book.Posts,you can also copy the paintings with delicate and delicate colors that are difficult to achieve in the traditional Linyi method.MR can not only display the full frame statically,but also display the process of book writing and painting in a one-off manner,which is equivalent to teaching by hand.In addition,the MR-based calligraphy and painting copying system can work in the way of writing,that is,displaying the book/poster without interruption for a long time,or working in the form of posting,that is,intermittently displaying the book/poster,and the traditional paste and Write two different exercises that are concentrated in one system.At the same time,the MR-based calligraphy and painting Linyi system is a pure digital system,economical and environmentally friendly.In this thesis,an optical transmissive MR helmet is proposed and designed.The three-dimensional registration problem in optical transmissive MR helmet is deeply studied,and the relevant transmission transformation formula is derived.Monitoring the helmet movement through the mobile phone,realizing the extraction from the image feature points,to the spatial position and posture decoding of the mobile phone and the inverse transformation of the book iron/painting space,so that the book iron/painting post displayed on the desk is integrated with the desk,and does not move with the helmet.And move.In this thesis,the ZED depth camera is combined with the HTC Vive VR helmet to program on the UNITY 3D platform.A video transmissive MR helmet is realized.The ZED camera's spatial position and attitude automatic tracking capability is used to solve the three-dimensional registration problem.The book iron/painting placard displayed on the desk is integrated with the desk and does not move with the movement of the helmet.Experiments show that the development of this thesis proposes that the MR-based painting and calligraphy system works stably.The system can be used not only for calligraphy and painting,but also for skill training and virtual training in related industries.