Font Size: a A A

Research On Human-Computer Collaboration Security Based On Deep Learning

Posted on:2022-12-09Degree:MasterType:Thesis
Country:ChinaCandidate:M L XiFull Text:PDF
GTID:2518306743971609Subject:Mechanical engineering
Abstract/Summary:PDF Full Text Request
With the complexity of production tasks and production environments,more and more scenarios require human-machine collaboration.The first consideration for human-machine collaboration is safety,but in actual production,most traditional industrial robots do not have the ability to perceive personnel information.With the ability of flexible control,only simple tasks can be repeated.At the same time,in order to ensure the safety of workers,the working space of industrial robots is usually isolated separately,which not only takes up a lot of working space,but also is not conducive to the configuration of automated production lines.In response to the above problems,this article focuses on the traditional industrial robot human-machine collaboration safety method,the main research work is as follows:(1)Research on task recognition based on deep learning.Aiming at the problem that industrial robots can only perform simple tasks and repetitive operations in human-machine collaboration,the improved YOLO v4-Tiny-ours target detection method is used to identify the work tasks of the collaborators,and the robots select the corresponding ones according to the work tasks of the collaborators The working path enables industrial robots to have intelligent decision-making capabilities in human-machine collaboration.(2)Research on human body posture estimation and measurement methods.Aiming at the problem that traditional industrial robots do not have the ability to perceive the spatial position information of collaborators,a deep learning-based binocular stereo vision measurement method is proposed.After the binocular camera is calibrated,plane correction and stereo correction are performed,and then the Alphapose human body pose estimation algorithm is used to output the human body joint parallax values corresponding to the left and right cameras are calculated and output the spatial position information of the human body posture.(3)The overall design and realization of the human-machine collaboration safety system.According to the actual human-machine collaboration scenario,a safety method based on the minimum safety distance is proposed,and the proposed method is verified on the actual industrial robot system.The design and basic realization can ensure the safety of human-machine collaboration and enable industrial robots.A human-computer collaboration system with perception and intelligent decision-making capabilities,while using Unity virtual reality technology to visualize the human-computer collaboration environment,which can remotely monitor the real collaboration space in virtual scenes in real time,making human-computer collaboration safer and more efficient.
Keywords/Search Tags:Deep learning, Human-machine collaboration, Visual measurement, Safe method
PDF Full Text Request
Related items