Design And FPGA Implementation Of Infrared And Visible Dual Light Fusion Imaging System

In recent years,image fusion technology has been widely used in the fields of target detection,military operations,medical and video surveillance.The fusion of infrared and visible images can reflect the respective advantages of the two images in the fused image at the same time,especially at night or under adverse weather conditions.The dual-light fusion system can better complete the imaging task.However,the current infrared and visible light fusion system still needs to be improved in terms of real-time,miniaturization,low power consumption and fusion effect.In this paper,we use Cyclone Ⅳ series FPGA as the core to design and build a real-time IR and visible fusion system.Firstly,according to the requirements of the project,the general idea of dual-optical fusion system design is given,and the dual-optical fusion system is mainly composed of five modules.Complete the device selection involved in each module,and complete the schematic diagram and PCB drawing of the hardware circuit in combination with the component data manual;Complete physical welding,simulate and test the circuit;Finally,the hardware system was built according to the test program,and the correctness of the hardware design was verified through program programming,and the design and production of the hardware part of the system was completed.Secondly,the design of visible light driver module,infrared driver module,data storage module and VGA control module was completed.Perform simulation verification on the designed modules,and ultimately complete the driver design for each module.Integrate all driver programs to complete system initialization and overall driving.The data storage module is prone to data loss,and a new caching mechanism is introduced to verify the effectiveness of the storage module under this mechanism,which can meet the normal operation of the system.We have built an infrared and visible dual light real-time display system,which can complete image acquisition and display functions normally,proving the correctness of all the above designs.Finally,the existing median filtering algorithm is improved to speed up the operation of the median filtering by using the hardware acceleration feature of FPGA;The algorithm is ported to the FPGA platform for verification.Combined with the idea of camera calibration,the dual-light image alignment function is constructed,and the equations of camera alignment parameters are derived through experiments to complete the alignment of the dual-light images;Through simulation experiments,the optimal weights for image fusion of the dual-light fusion system are derived and the dual-light image fusion is completed.The simulation and experimental results of the constructed dual optical fusion system demonstrate the effectiveness of the proposed algorithm and method.The research in this paper provides a theoretical and technical foundation for achieving a more portable and real-time infrared and visible light fusion system,and has certain practical application value.