Research And Implementation Of Real-time Video Mosaic Technology Based On Zynq

With the rapid development of digital video technology,video image mosaicing technology has become one of the important research topics in the field of computer vision.At present,video stitching technology in digital broadcasting,video surveillance,virtual reality and medical imaging and other fields have been widely used.As the video mosaicing technology to deal with a large number of image data,the processing speed requirements of high,so to develop a set of real-time,low power consumption,small size video mosaicing system has important practical significance.The system uses Xilinx Zynq-7000 series of fully programmable system-on-chip platform,on-chip integrated dual-core ARM Cortex-A9 processor,Xilinx 7 series FPGA and the high-speed interconnection structure,using hardware and software co-design method to integrated the functions of video capture,video stitching,high-definition display in an embedded system.Compared with traditional single processors such as DSP,ARM and FPGA,this method not only fully utilizes the powerful parallel computing ability and rich logic resources of FPGA,but also combines the advantages of ARM in building operating system and realizing complex algorithm.The works accomplished in this design are as follows:(1)In the ZedBoard development board equipped with Zynq chip,build embedded Linux development environment,including the startup file production,cross-compiler environment to build,OpenCV and Qt installation and migration.(2)A hardware-accelerated IP core is designed using Vivado’s high-level synthesis(HLS)tools,including Harris corner detection algorithm and image Fourier transform inversion algorithm.(3)In Zynq chip Programmable Logic(PL)part of the completion of the hardware engineering structures,including hardware-accelerated IP core mount and configuration,Video Direct Memory Access(VDMA)configuration and HDMI high-definition display control.(4)In the Zynq chip processor system(Processing System,PS)part of the ARM to achieve system software design,including VDMA IP core and custom hardware-accelerated IP core driver design,using OpenCV library and custom hardware acceleration IP core to achieve video image capture and video stitching functions.This design uses the hardware and software co-design method to complete the Zynq real-time video stitching system,which has short development cycle,good real-time,small size and friendly interface.