An FPGA-Based Video Tracking System On Machine View

Video tracking is a hot issue of computer vision and intelligent video surveillance whichrefers to many fields, including image processing, pattern recognition, automatic control andartificial intelligence, and has superb application prospect. Video tracking system of machinevision based on FPGA(Field Programmable Gate Array) can solve some defects of previousvideo tracking systems, such as poor real-time performance, low refresh rate, expensive price,huge volume, etc. It will be in possess of promising market if we can make batch productionor develop dedicated video tracking system chip.Firstly, a real-time video capture and display system on FPGA is designed, whichincludes logical hardware modules like CMOS real-time image acquisition, image sensorconfiguration, image format conversion, multi-port SDRAM controller design, graphics framebuffer, image VGA display, etc. Secondly, through the algorithms of real-time video targetdetection, location and tracking, we set target parameters, collect target motion trajectory andcalculate the stepper motor control signals. Moreover, the biaxial stepper motor circuits aredesigned to make cradle head camera move by controlling signals of PTZ stepper motor.Finally, after integrating each subsystem of real-time video tracking system on FPGA, wedebug and optimize the video tracking system.The experimental results demonstrate that the proposed video tracking system on FPGAmeets the expected requirements of real-time capabilities and accuracy, and refresh rate is upto 30 frames per second. Not only can the optimized target detection algorithms effectivelyextract object edges, but they reduce the background noises. Target edge centroid can beobtained by using centroid localization method so as to rotate PTZ motor 360° in horizontaldirection and 120° in vertical direction. In contrast with the conventional video trackingsystem, the proposed system achieves good real-time performance, precise tracking target,etc., and lays a solid foundation for the further research in the future.