Research Of Multi-source Image Fusion Based On FPGA

Multi-source image fusion which can effectively overcome the single sensor shortage has been widely used in various fields. Recently, the fusion of the infrared and visible images has been a research hotspot. The infrared images can accurately obtain the location of the hot target. In constrat, the visible images can provide abundant background information. We can integrate the both through a certain algorithm to get the image of more abundant information.In this paper, we study multi-source image fusion system, mainly including the devisal of the hardware platform and the theory algorithm. The design of hardware includes storage, processing, and high-speed transmission of the image datas. We complete the parts of the hardware design in the Xilinx Spartan3 an Development. We introduce the two standard images by using Flash controller. The data cache in the DDR2 memory, then we use Microblaze to process the fusion algorithm. The fused image is displayed through the VGA. At the same time, we have also developed the design of high-speed data transmission based on FPGA and USB2.0. Finally, the fused image can be transmitted to the PC.According to the different characteristics between the infrared and visible images,two kinds of image fusion algorithm are proposed in this paper. The one is the fusion of infrared and visible images based on non-negative matrix factorization and infrared feature extraction, the other is the fusion which is more suitable for implementation on hardware based on compressive sensing. These methods have great advantages, whether from the visual effects or from the performance indicators.Finally, the whole fusion system has been debugged on to verify the feasibility successfully. Furthermore, this paper looked into the future for the system on basis of summarizing the total design of the system and proposed the applicability for some other imaging system under the case of improving the hardware and algorithm designs.