Design Of Panoramic Video Imaging System For Large Special Vehicles

With the car ownership increasing,there is an increasing demand for panoramic video assisted driving systems.In recent years,with the rapid development of microelectronics,the low-power embedded video processing chip become more mature,which makes the vehicle have the preconditions for panoramic video system.The panoramic video system can provide anaerial panoramic image around the vehicle,which can eliminate the visual blind zone,improve the driver’s driving safety and reduce the driver’s driving difficulty.Compared with small-sized passenger cars,large special vehicles have larger bodies,which leads to a larger range of blind zone.It is more difficult to drive through some narrow road conditions and access to the tunnels.Therefore,large special vehicles have a higher demand for panoramic video imaging assisted driving systems.In this paper,the key algorithms of large special vehicle panoramic video system are studied.The image registration algorithms such as SIFT,SURF and ORB are compared.The distance weights are Participatedin SIFT,and the weighted least squares method is used to improve the algorithm stability of the image with the fuzzy region.OcamCalib is used to realize the wide-angle fisheye camera correction.The direct linear transformation is used to realize the aerial view of the image.The linear fusion method is used to realize the rapid fusion of the image,and finally get the aerial view panoramic image whichis the surrounding area of the vehicle.This paper also carried out the overall and software design of the large special vehicle panoramic video system,including: the overall design of the large special vehicle panoramic video system,and the embedded system using dual DSP and dual FPGA as the main control chip;The FPGA software design was completed,the SDI video input and image color space conversion of 10 1080 P camera were realized.The DSP software design was completed,the bird’s eye view transformation,improved SIFT image registration and image fusion were realized.Finally,the panoramic video system displayedthe image of 360° and 5 meters distance zone around the vehicle,which eliminated the blind spot of the driver,reduced the driver’s driving difficulty and improved the safety of driving.