| With the development of science and technology and the progress of the times,traditional two-dimensional video display has been unable to meet the growing needs of people.At the same time,3D video display technology that can provide more comprehensive and multi-angle information has entered the public's field of vision and received wide attention.The acquisition,recording and display of video information in 3D way have become an inevitable trend in the development of display technology.With the rapid development of 3D display technology,its proportion in people's life and work is increasing.Live broadcast will also be one of the important application scenarios of 3D display technology.Compared with the traditional two-dimensional video,three-dimensional video has a larger amount of original data.If it is not compressed,the limited bandwidth and storage space will be difficult to support its smooth transmission.Aiming at the difficulties of building dense view 3D light field video live broadcasting system,this paper makes a research breakthrough,designs and realizes the key nodes of acquisition,coding,transmission,playback and other systems,builds a complete dense view 3D light field video live broadcasting system,and verifies the live broadcasting of real human body,which can live display nearly 8K resolution 3D light field video.The system can provide a good experience to the user.The main work and achievements of this paper are as follows.1.The coding method of dense viewpoint light field is implemented.In this system,the compression coding technology of 3D optical field video is studied,and the feasibility coding scheme of HEVC-8K is proposed to realize the compression coding of the collected dense viewpoint video images by the acquisition platform.Based on multi-view video coding HEVC-8K problem of low resolution of multi-view images of high resolution 3D light field image compression,video coding and multi-view 3D optical field features,this paper proposes a single channel coding method,which can avoid the crosstalk phenomenon of multi-view video coding and improve the visual perception.Since this method expands the resolution of the original video image by two times,this paper proposes to use the deep learning-based coding method to codec the ultra-high resolution image and achieve the good results.2.The complete research and construction of the 3D light field acquisition and live broadcasting system with dense view point have been realized.Based on the multi-view images collected by the system,a method of image calibration and correction based on multi-view images is proposed.The acquisition platform of the system is designed and built.RTMP protocol is constructed and extended to realize the push stream transmission of video data encoded in HEVC format.The system has also built a GPU-based pull streaming player to play the video transmitted by push streaming.In the end,a 3D light field video live broadcast system with dense view has been completed for live broadcast verification,which can transmit nearly 8K resolution video and play it on the 3D light field display independently developed by the team. |
PDF Full Text Request