Special Vehicle Exterior Observation System Based On Viewing Angle And Image Stitching

As a necessary observation equipment for special vehicles with closed compartments,the extravehicular observation system is one of the important ways for personnel to observe and identify the external environment.In view of the advantages and disadvantages of existing technologies,for the purpose of presenting the scene outside the cabin accurately and conveniently to the driver in real time,this paper proposes a research on the view system of special vehicles outside the cabin based on visual Angle and image splicing after analyzing the system requirements and using environment.The main content is as follows:In this paper,PSD optical positioning model,inertial attitude sensing model,helmet perspective determination model,image feature extraction and matching model,perspective display model are analyzed and designed.At the same time,software and hardware design of PSD optical positioning module,inertial attitude sensing module,helmet perspective determination software design,FPGA image processing module hardware algorithm design and helmet perspective display design are respectively carried out.In the system,the PSD optical positioning module uses laser to detect the 3d coordinates of the helmet cabin,the inertial attitude sensing module uses the inertial detection quantity to detect the 3d attitude of the helmet,and the Angle determination algorithm obtains the corresponding perspective information of the helmet based on the synthesis of 3d coordinates and attitude information in the cabin.The FPGA image processing module selects video data of multiple cameras in the system according to the perspective information,extracts features and splices images,and sends them to the helmet perspective display for display.The experiment show that,the 3d coordinate detection accuracy in the helmet cabin of the system in this paper is within 2cm,helmet attitude and view angle detection accuracy are within 2 °;The computation period of FPGA hardware image processing algorithms is on the order of milliseconds and the real-time performance of image processing algorithm is greatly improved.At the same time,the helmet perspective display can achieve a good perspective display effect.In this paper,the system meets the actual observation needs of special vehicle cabin,and has high application value.