The Realization Of 3D Roaming Technology Based On Panoramic Video

Virtual reality(VR)technology can provide an immersive feeling for viewers.With the rapid development of VR technology,virtual roaming is becoming increasingly important.Meanwhile,video is an effective media to provide intuitive feeling and great visual experience to viewer.In this paper,we propose a panoramic video based 3D roaming method to help viewers to perceive the video content as if he or she is walking inside the video scenes.Also,a feasible solution of 3D roaming is implemented to demonstrate the effectiveness of the proposed method.To enable viewers to have an immersive feeling of video scenes when they perceive the video content,we need to have two essential video technologies.One is to present the audience with panoramic videos with 360 degree at horizontal and 180 degree at vertical.Besides,view-adaptive video playback technique along with 3D effect is also indispensable to allow viewers to interact with the video content and have an immersive feeling.For the first technology,we propose a fast video stitching algorithm based on fisheye lens to get a better panoramic video more close to the human senses.Meanwhile,we extract Chroma features from videos to deal with frame synchronization.For the second technology,we propose a Fake-3D and True-3D mix method to immerse viewers inside the video scene via its dynamic playback of panoramic videos,adaptive to multi-view changes.In this paper,we also provide a feasible solution of 3D roaming to demonstrate the effectiveness of the proposed method.In detail,according to the above two technologies,we develop two 3D roaming systems.The first one is “3D panoramic roaming system”.In this system,a moving chassis with multi cameras is utilized to capture panoramic videos in the roaming scene.And then pHASH algorithm is adopted to find the intersection of the videos.We cut videos according to their intersection and get basic video segments.Finally,we combine these video segments together to let viewers be able to roam around in the scene.The second one is “Fixed point panoramic 3D playing system”.A fixed binocular fisheye is utilized to shoot vertically to get sequence background images.When the view is changed,we just need to switch to the corresponding background image to better restore the 3D information of background.And then the moving object captured by a stereo camera is superimposed to the background image to let the moving object get rid of the time and place.This system also solves the problem of excessive transmission bandwidth when applying in the field of panoramic video webcast.Our proposed technologies have great potential in practical applications,such as virtual reality gaming,new concept movie shows,video webcast,and etc.And the two systems have reached the basic practical requirements and also have very good market prospects.