Eye-Controlled Interactive Technology And Its Application In Augmented Reality

Augmented reality is a hot research topic, which has shown an increasingly important position and role in all aspects of social life. It has extensive application value in the fields of industry, agriculture, military, medical and anti-terrorism. Eye control interaction as the only and the most promising next generation of human-computer interaction methods can replace the mouse and keyboard. In recent years, augmented reality has been continuously developed and improved at the theoretical research and practical application, and it has become a hot research topic in the field of human-computer interaction. The thesis integrates eye-controlled interactive technology into augmented reality research, which proposed and implemented a new eye-controlled interactive way of augmented reality. The main work of the thesis includes:1) Summarizing the augmented reality technology trends and Human-Computer interaction design principles, proposes the new idea for Human-Computer interaction of augmented reality based on eye-controlled technology.2) Describing the basic types of eye movement and the design principles of eye-controlled interactive technology. Eye-controlled interactive technology development framework is proposed.3) Eye-controlled method based on saccades is first proposed, named diagonal saccade method. To ensure the robustness of the algorithm we have conducted the adequate experiments and selected the appropriate threshold for the diagonal saccade method. The innovative experimental methods in this thesis will inspire the related research work in this field.4) Summarizing the process and frameworks of real-time eye movement data. Traditional eye movement identification methods were designed for the eye gaze points, which had the same sampling frequency, but eye movement data in this thesis were obtained by processing the eye gaze points, so traditional eye movement identification methods were not suitable for identification of5) diagonal saccade method. In this thesis, improved the traditional eye movement identification methods and implemented a new real-time eye movement data processing algorithm.6) Based on the eye-controlled interactive technology framework proposed in this thesis, and aiming for the application to the augmented reality head-up display, a new kind of eye-controlled augmented reality head-up display system for the driver is developed.