The Design And Implementation Of The Mixed Reality English Teaching System Based On Origami

How to make educational products both attractive and effective has always been a concern of the academia.Traditional English language teaching methods focus on the cultivation of reading and writing skills,but lack of the training of the oral English skill.Although developers have provided many applications for oral English training,most of these applications just simply provide multimedia materials,without the sense of immersion and vividness.At the same time,mixed reality technology has a high degree of the sense of immersion and vividness,and in a variety of studies on the integration of mixed reality technology and education,it has also been proved to have advantages in all aspects.Also,the research proves that storytelling is an effective means as an educational tool.If it is combined with oral English teaching,it might give play to its advantages and improve the.teaching outcomes.In addition,as an art manual activity,it has proved origami can enhance children's hands-on ability and thinking ability.So,how to combine the advantages of these elements to design and develop an English teaching system which is more immersive and interesting,is a problem we hope to solve.Based on current related works,this thesis analyzes the requirements of the system,and introduce the design and implementation of this mixed reality English teaching system based on origami.Then,based on the requirements analysis,we carried out the architectural design and detailed design of this system,and finally we tested this system after the completion of its development.The system has five functional modules:origami tutorials,animation play,story design,storytelling and general functional modules.Teachers can design English story lines in the story design module to design custom teaching contents.Also,students can learn the art of origami in the origami tutorials module.They can also watch animation,which contains English dialogues,in the animation play module.In addition,they can participate in the storytelling in the storytelling module by using tangible interface.The general functional module is responsible for providing visual and auditory feedback for users' operations,in order to make the interaction in the mixed reality environment more natural and barrier-free.The software development environment of this system is Unity3D,and the development language is C#.It runs on the platform of Microsoft HoloLens,a mixed reality headset.We use a variety of technology to develop this system:Unity3D game development technology,vuforia-based tangible interaction technology,mixed reality storytelling technology and English teaching technology based on speech synthesis and recognition.We use Unity3D game engine to implement each functional module.Vuforia SDK is used to implement the origami-based tangible interaction in mixed reality environment.Combined with HoloToolkit and Unity3D' s collision detection API,we integrated more natural and novel interaction modes into our system,such as gaze interaction,gesture interaction and voice interaction,in order to make the user experience in interaction more natural and smooth.Compared to traditional multimedia teaching system,this system has a higher sense of vividness and immersion.We uses mixed reality technology to enhance the sense of vividness in this system,and aim to bring more engaging and immersive experience to users.In addition,it integrates digital story telling with English teaching,which aims to train students' oral English skills in a more entertaining way.Besides,we use origami to train hands-on and thinking abilities of students.We developed this system,and aims at integrating the advantages of various technologies,to effectively improve children' s hands-on ability,thinking ability and the oral English skill.The research on this system would have positive significance to the application and development of the mixed reality technology in the field of education.