Software And Hardware Co-design Of Image Registration And Mosaic Based On Zynq

Image mosaic technology refers to the process of collecting all important information from multiple images and mosaicing the information into a single image.As one of the important research topics in image processing technology,image mosaic technology has high practical value in remote sensing image,medical image,assisted driving and other fields,and has also been widely developed and valued.The image mosaic technique studied in this paper uses the Zynq scalable processor platform,which uses the structure of ARM+FPGA.For the registration and mosaic of visible light images,the image registration algorithm and the mosaic image display in the image mosaicing technology were completed on the FPGA side by means of software and hardware collaborative design.The image acquisition,graphical interface and the whole system control and mosaicing images were completed on the ARM side.ARM and FPGA used VDMA for data interaction.In this way,the powerful parallelism and rich logic resources of the FPGA can be fully utilized,and the advantages of ARM running the embedded system and processing the complex algorithm can be utilized,the design flexibility and power consumption can be reduced,and the running speed of the whole system can be improved.In this paper,the flow,advantages and applicable scenarios of commonly used image registration algorithms were analyzed in detail.The algorithms were compared and analyzed,and the phase correlation method and ORB algorithm were transplanted to the FPGA for hardware acceleration.This design used a high-level synthesis tool to transplant the image registration algorithm to the FPGA.The phase correlation method IP core included image Fourier transform,cross-power spectrum calculation and inverse Fourier transform of the image.ORB image registration IP core included fast corner detection,Harris corner response and BRIEF descriptors.Through the development of C language,simulation,optimization of resources and other operations,it is integrated into RTL-level code packaged into an image registration IP core.And used Vivado to build the IP core into the hardware circuit to achieve hardware acceleration of image registration.This paper also summarized the practical process and optimization methods of the high-level integrated development process.This design mainly accomplished two types of tasks on the ARM side.On the one hand,it fused the source image according to the result of image registration IP core,and on the other hand it controled the image mosaicing system,including image acquisition and image data to be registered.Reading and writing control,VDMA configuration,graphic interface and the drive design of image registration IP core,the transplantation of embedded Linux system were accomplished in this design and realized the software and hardware co-processing of image mosaicing system.After experimental verification,the image mosaicing system can run well on the Zeboard development board,and realized an embedded image mosaicing system with good interface and high processing speed.