Design And Implemtation Of Human-machine Interaction System Based On Augmented Reality For Double-sided Lathe

Augmented reality technology is developed from the virtual reality technology.It can superimpose virtual information in the real world and construct scenes which fuse both real and virtual information.Augmented reality technology has many applied researches in manufacturing,education,and exhibition.In the field of manufacturing,there have been studies using augmented reality technology to superimpose processing parameters in the processing area in real time,in order to allow operators to intuitively understand current processing conditions.However,the current research only uses this new display technology to present information to users.It does not consider the interaction between users and equipment.In addition,the system does not provide operation guidance to the user and does not monitor the user's operation.In order to perfect these deficiencies,this thesis proposes a human-machine interaction system based on augmented reality for double-sided lathe.The system can integrate virtual digital equipment with real equipment which could provide operation guidance to the user and monitor the user's operation.Moreover,users can naturally interact with manufacturing equipment.The thesis completes the following main tasks to implement the system:(1)The thesis studies the interactive technologies in augmented reality scenarios.A cone-view method for detecting the user's gaze is proposed.The thesis uses the Leapmotion controller to recognition more gestures and designs the data transmission schemes between the two devices.Eight easy-to-interact gestures were defined and implemented.The thesis designs the interaction logic between the user and the system in augmented reality scenes based on the three interaction modes of sight,gesture,and voice.(2)The thesis studies realistic modeling of double-sided lathe and the implementation of special effects based on shaders.The thesis uses the texture mapping technology to improve the surface effects of the digital Double-sided lathe.Programmable shaders are used to implement special effects in augmented reality scenes,including the part's translucent fluorescent effects,and the spindle temperature color distribution rings.(3)The thesis studies the multi-user scene sharing technology in the augmented reality scene.Thesis proposes a method of establishing a reference coordinate system based on logos,and proposes an easy-to-expand method for sharing data among multiple users.Thesis use a camera and a computer to render high-quality virtual reality images on the screen in real time.(4)The development of human-machine interaction system based on augmented reality for double-sided lathe was completed.The system mainly includes five functions: working condition perception,processing prediction,human-machine collaboration,simulation and training,and remote monitoring.The hardware structure of the system is designed and the function modules of the system are divided.Design user interaction interfaces,write business code to implement system functions.