The Research On Multi-source Image Fusion Based On FPGA And DSP

Image fusion has been widely used in many fields，effectively overcome thesingle sensor shortage. Recently, the fusion of the infrared and visible images hasbecome a research hotspot. The infrared images can obtain accuracy location of targetand overcome the severe environment. In contrast, visible images can provide clearerand detail background information. We can integrate effective of both to get an imageof the human eye observation and more abundant information.The thesis work focuses on the research on multi-source image fusion technology,include the devisal of the hardware platform and the theory algorithm. We analyzerespectively characteristics of infrared and visible images and research is dedicated toboth fusion algorithms. The proposed algorithm break through the traditional methodand is applied by the target extraction、two-stage fusion and so on. By the contrastexperiments, we validated the effect of fusion algorithm. In hardware design stage, weanalyze the characteristics of FPGA、DSP、ARM to confirm the hardware system plan.We design a fused system based on FPGA+ARM. FPGA is used for image dataacquiring, while ARM is used for algorithm processing and communicate with PC. Tothe data transmission between FPGA and ARM, we connected the RAM of FPGA tothe bus of ARM system, which is shared the same memory. By the GPMC controller,FPGA and ARM make the data transmission. EDMA is used as communicationbetween ARM processor and FPGA which can improve data transmission rates andrelease the ARM processor. The whole system adopted the design form of singleboard and loading board to the scalability.The thesis mainly achieved the overall fused system design, include the schemeof system、the design of circuit、PCB design of loading board、the data transmissionof ARM and FPGA、the researching of the fused algorithm and the preliminarydebugging.