Research On Dual-Channel Interaction Strategies Integrating Eye Control And Hand Control

With the development of society and the advancement of science and technology,interaction design is not only limited to system usability,but also further emphasizes improving usability and user experience,which has spawned a series of human-computer interaction method that aimed at improving interaction efficiency and interaction experience,such as eye control,brain control,and multi-channel interactive control.Among them,eye-control interaction is a new type of human-computer interaction method that uses sight as the interactive input channel.In order to solve a series of scientific problems of eye-control interaction,consider designing a multi-channel interaction method.The integration of touch interaction and eye-control interaction can improve the problems of single-channel eye-control interaction in time and space dimensions.By analyzing the research status of eye control interaction,touch interaction and multi-channel interaction at home and abroad,and combining the characteristics of eye control and hand control interaction and the design principles of interactive systems,summarize the design principles of dual-channel system integrating eye control and touch control.According to the Post-WIMP interaction behavior model,a natural mapping of interaction instructions and eye control and hand control interaction methods is formed.Further,according to the eye control and hand control interaction cooperation mechanism,two specific two-channel interaction modes are proposed,namely "eye control locking-touch triggering" and "signt positioning-touch switching system status-eye control triggering".In order to explore the interaction efficiency and user experience of the dual-channel interaction strategies integrating eye control and hand control,based on the dual-channel interaction system framework,Unity is used as the experimental system development platform,and the Tobii eye tracker is used as the sight acquisition and input device.Develop an open-source dual-channel interactive system integrating eye control and hand control as a research and experimental platform.According to the research on the dual-channel interaction strategy and the position of interface elements,the following conclusions are drawn:(1)The dual-channel interaction system integrating eye control and hand control should choose the interaction strategy of "eye control locking-touch triggering" to ensure high interaction efficiency and usability;(2)The interface layout location factor does not have a significant impact on the interaction efficiency,and the subsequent feature experiments can eliminate the influencing factors of the interface layout factor.In the research on the characteristic factors of fixation duration under the dual-channel interaction strategy,the following conclusions are drawn:(1)From the perspective of interaction accuracy,the fixation duration in the range of 100-600 ms can constitute good human-computer interaction mode;(2)From the perspective of interaction efficiency and user preference,the optimal gaze duration under the dual-channel interaction strategy ranges from200 ms to 400 ms.Based on the research on the combination of fixation duration and unlocking duration under the dual-channel interaction strategy,the following conclusions are drawn:(1)From the perspective of interaction accuracy,the combination of fixation duration in the range of200-400 ms and unlocking duration in the range of 100-600 ms can constitute good human-computer interaction methods;(2)From the perspective of interaction efficiency and user preference,the optimal unlocking duration under the dual-channel interaction strategy is in the range of 100-200 ms,and the recommended combination of fixation duration*unlocking duration is 300ms*200ms.Aiming at the scientific problem of single-channel eye control,this topic proposes the dual-channel interaction modes integrating eye control and hand control according to the characteristics and cooperation mechanism of eye control and hand control,and further combines eye control and hand control interaction actions according to the operation process and purpose,forming specific two-channel interaction strategies,which is universal in research.In addition,this topic comprehensively uses the method of ergonomic experimental exploration combined with subjective evaluation,from the perspective of objective interaction efficiency and subjective usability score,the interaction strategies and the characteristic factors under the interaction strategy are studied,the experimental conclusions are scientific.The research results of this topic can effectively improve the interaction efficiency and usability of the dual-channel interaction system,which is beneficial to promote the application and popularization of eye control interaction in many fields.