Research On Combine Harvester Operations Video Monitoring System And IoT Application

As the important tool of modern agriculture and the important basis of agricultural mechanization,combine harvester has quickly developed and widely used in recent years.Its development degree directly influenced the agricultural productivity and the process of the agricultural modernization.At present,the information level of combine harvester is generally low in our country and the condition monitoring and fault early warning of the harvester often depend on the driver's experience.If agricultural machinery manufacturers or harvesting organizer want to know the state of the machine,they often have to go to the scene investigation.It is difficult to meet their requirement of real-time,accuracy and fastness for the harvester field information.There are many problems,such as the lag of operation information,the lack of timeliness,the difficulty of monitoring and management.Video images include intuitive and rich information,through the combination of video information and location information,it is possible to transfer the agricultural machinery operating conditions in a timely and intuitively manner to the relevant personnel of the agricultural operation process.Using video monitoring technology for collecting combine harvester job site information,and transmitting video information to the remote monitoring center via wireless network,through the IoT platform for equipment and information management.It can provide the information of the scene for combine harvester driver,agricultural machinery manufacturers,harvesting organizer timely.It is of great significance to the assessment of agricultural machinery operations,fault analysis and accident emergency disposal and even the development of agricultural informatization.After analyzing the working process of combine harvester,selecting the the granary,threshing drum,cab and cut table as the objects of video surveillance.The video monitor and IoT application system of combine harvester operations was designed by combining with sensor technology,embedded system technology,satellite positioning technology and IoT technology.The system can be divided into three parts: the front-end airborne embedded system,the remote indoor large screenmonitoring center and the IoT platform.Taking Jetson TK1 development board as the hardware platform of front-end airborne system,the transplant of embedded Linux system including U-boot transplantation,Linux kernel tailoring and driver transplantation,making and flashing root file system.Designed submodules to achieve the operation site video capture and display,video image compression and remote transmission,image data and positioning information access to IoT platform and other functions.The system is divided into airborne monitoring mode and remote monitoring mode.In the airborne monitoring mode,the system uses a number of USB cameras installed in multiple parts of the machine to capture the live image of the harvester then display to the cab LCD monitor screen.By using the GPS module,determining the geographical position of the harvester in real time.In the remote monitoring mode,transmitting live video images to remote large screen monitoring center via 4G wireless network and accessing the image data and location information to the IoT platform.After the completion of the system platform design and application development,the experiment was carried out to verify the the function of each program module and the operation effect of the whole system.The results showed that airborne video monitor program can normally collect and display multi-channel video images.In the resolution and frame rate were 640×480 and 25 fps respectively,it can support 4-channel monitoring at the same time and the CPU and memory occupancy were 69.66% and 1.2% respectively.The embedded video server can transfer live video images to remote large screen monitoring center,and achieved real-time video transmission of 25 frames per second and resolution of 640×480,frame loss rate of 2.11%,and supports inter-channel switching and multiple simultaneous monitoring.Image data and positioning information can be successfully uploaded to the IoT platform,thus users can log on the Io T platform for data viewing and equipment management.The test results verify the feasibility of the video monitor and Io T application system for combine harvester operations.