Design And Implementation Of Gesture-Based User Interface Development Tool On HTML5

In recent years,with the popularization of portable interactive devices such as mobile phones and tablet computers,gesture interaction has gradually become the most common way for people.The current interaction mode of mobile devices is no longer limited to touch gestures.Users can interact with the system through various types of gestures.That is to say,in the developing process of user interfaces,it is often necessary to mix and use a variety of gesture interaction technologies.Therefore,how to quickly design a user interface that is easy to use and has a good user experience has become the focus of attention.However,when developers use traditional methods for software development,they need to master complex gesture recognition algorithms and directly use these algorithms to develop user interfaces based on gesture interaction.This leads to high learning costs,and developers need to face the problems of low efficiency and poor maintainability of user interface development based on gesture interaction.Therefore,people currently use tools such as gesture libraries to assist in the development of user interfaces based on gesture interaction.However most existing gesture libraries only support a single gesture type,and do not support developers to design new gestures.Besides,it need to be developed in procedural languages,which makes the learning cost relatively high.In view of the above problems,this paper analyzed and studied the related technologies of user interface design based on gesture interaction and made full use of the sensor design provided by mobile devices to design some new gestures.We built a library of gestures including touch gestures,visual gestures,and sensor gestures.Based on this,we designed and implemented a Gesture-based User Interface Development Tool(GUIDT)on the Web platform,including three parts,which are gesture library,parser and an Extensible Gesture Markup Language(EGML).EGML allows developers to describe the relationship of gestures,interface elements and interactive events at a high level of abstraction,without the developer having to care about how gestures are implemented and how gestures are bound to interface elements.Since the XML language is a descriptive language,EGML is easier tomaster than traditional development methods.Through the use of Gesture-based User Interface Development Tool,the difficulty of development is reduced and the efficiency is increased.