Research On Walkthrough System Based On Tri-View Morphing

Virtual walkthrough is an important branch of virtual reality,and it means that the user wears a virtual reality device to walkthrough in real-world or virtual scenes.In the development of the virtual walkthrough system,people summarize three 'I's to describe its characteristics,which are Immersion,Interaction and Imagination.Immer-sion means the authenticity of the virtual walkthrough system,Interaction means the degree of interaction between the user and the virtual environment,and Imagination means the cognitive ability of the user in the virtual environment.Virtual walkthrough system is widely used in many fields,such as urban planning,medical,entertainment,education,military and aerospace industry,interior design,engineering development,industrial simulation,military simulation,road and bridge construction and so on.It enriches people's entertainment and changes the way people live.The most important thing of measuring the quality of a virtual walkthrough system is about the novel view rendering algorithm.For a long time,many scholars and engineers are dedicated to the study of novel view rendering algorithm to build a virtual walkthrough system that meets the three 'I's standard.Currently,great progress of novel view rendering has been made in the academic field.However,huge challenges still stay in real-time ren-dering and outdoor scenes,which has prompted more and more scholars and engineers to devote more efforts to the novel view rendering algorithm research.In this paper,an image-based walkthrough system is proposed to navigate real-world outdoor scenes based on only three uncalibrated images without the reconstruc-tion of 3D model or any geometric information.An image based rendering operation is executed on these sample images,and realistic novel view is generated between the views in real time.We divide the caculation into online and offline parts and optimise the traditional two-step view morphing to real-time tri-view morphing based on epipo-lar constraint.Compared with other tri-view morphing methods,our scheme is well suited to complex outdoor scenes and wide baseline scenarios,which also provides a qualified alternative to state-of-the-art dense 3D reconstruction.Wearing a head mount-ed display(HMD)like Oculus Rift,users can experience real and immersive real-world scenarios.