| Human knowledge is divided into four categories,descriptive knowledge,normative knowledge,practical knowledge and formal knowledge.Practical knowledge and normative knowledge can only be understood and mastered after practice,such as writing,drawing,distinguishing direction,judging weight,etc.Since traditional interaction methods such as mouse and keyboard are different from the natural interaction in real life,their application in educational games is not conducive to the mastery of practical knowledge,so the application of non-traditional interaction methods in educational games has received more and more attention from scholars.Main research work about this thesis including four aspects:1)An intelligent filling method for answers based on mobile interaction is proposed.In order to reduce the influence of the surrounding environment on the image data,pre-processing operations such as filtering and denoising and binarization are performed on the acquired image first;in order to locate the position of the target brackets,the left and right brackets are located and identified respectively by using the template matching method;then the bracket pairing filter is used to realize the pairing of the left and right brackets,and the brackets are sorted;finally,according to the size and angle of the QR code,the data in the QR code are combined to generate Finally,according to the size and angle of the QR code,combined with the data in the QR code,an answer of matching size and angle with the original question is filled in the brackets to achieve a seamless integration of the answer with the original content,i.e.,the augmented reality effect.2)A SUP educational game framework based on the learning process is proposed,and an educational game based on mobile interaction and GPS service is developed based on this framework.The main purpose of the game framework is to enable students to deepen their understanding of the application scenarios of knowledge by placing them in real problem environments.The game can map the students’ surrounding environment,enhance their ability to solve real problems in real scenarios,and further validate the positive effect of the SUP framework on student learning.3)A writing judging method based on pen-based interactions is proposed.The method preprocesses children’s handwriting by mathematical morphological operations,and after using convolutional neural network for recognition,the handwriting is finelined and the skeleton is extracted using the improved Hilditch algorithm;then,features such as corner points,straight lines,arcs,handwriting pixel proportions and positions of handwritten digits are obtained,and these features are used as comparison elements,and the fuzzy comprehensive evaluation method to judge the writing quality of handwritten digits and provide real-time feedback.4)An educational game based on force feedback interaction was developed.The game uses the HTC Vive VR headset to achieve a visual VR experience and the Geomagic Touch force feedback device to achieve a haptic experience.The device transmits force information to the user and combines with the envelope box technology for intersection detection to enhance the sensory experience of human-computer interaction,allowing the user to unknowingly have a more intuitive feeling of strength,object weight and object material to enhance learning Interest. |