Research On Intelligent Selection And Interface Paradigm Based On Pressure On Multimedia Terminal

With the development and popularity of multimedia terminals equipped with touch screens,the two-dimensional touch technology,whose concept is “what you touch is what you get”,has become the mainstream of mobile interaction for its advantages including intuitiveness,simpleness and flexibility.However,with the development of science and technology,the multimedia terminals have become various and the information presented on the screen has been sharply increasing.Moreover,the usage scenarios have been extended from a stable and safe indoor environment to a more complicated and integrated environment,including walking,running,shopping and other life scenes.In this case,some limitations of traditional two-dimensional interactions have emerged.First,compared with stylus tips,the contact area for fingers is larger,which causes visual occlusion on the touch screen with limited size.Second,there are some interactions with frequent taps in the scenes of daily life such as selecting dates,counting numbers,and hybrid inputting Chinese and English characters.These interactions with taps only cause low efficiency and finger fatigue.Moreover,there are some difficulties in single-hand operation due to the screen size of mobile phones,and it is hard for users to select all the area on the screen with a single hand.Besides,two-dimensional touch gestures occupy much visual attention,and users' attention will be distracted from surroundings to the touch screen when moving,which has potential safety hazards in the complex environment.Therefore,extending and improving touch interaction has become a key research direction in the field of human-computer interaction.As a current popular interaction technology,pressure interaction uses the depth information to extend the traditional two-dimensional operations to three dimensions,allow users to control within spatial space,and provide more possibilities of interaction.On the one hand,controlling the x-y plane and the variable input by inputting along the z axis decreases screen and visual occlusion problems.On the other hand,pressure interaction provides a new dimension to distribute the content and the commands placed on the surface to different layers,which avoids information stacking up and makes the operation more concise.It provides a new solution to the problems above,and has been applied to various devices.However,pressure input is still facing some problems in current researches and implementations.First,the division for pressure space using bare fingers is usually 2 or 3 levels,which is larger-grained compared with using styli and tablets.Second,it is evaluated only in a stable indoor environment and lacks exploration in the complex environment.It also lacks a mechanism combining z-axis pressure and two-dimensional gestures,and the interaction space actually is still separated.Besides,the design of pressure-based applications still follows the plane-based WIMP paradigm,and there is no specific interface paradigm for pressure interaction.The current WIMP paradigm cannot give full play to the advantages of pressure interaction,and to some extent,it limits the development of pressure input on multimedia terminals.In this paper,we conduct researches around two aspects: exploring the pressure input technology under different situations,and designing interface for pressure interaction.After analyzing and summarizing the previous work,the confirmation methods that combine two-dimensional gestures for pressure input have been designed and two evaluation experiments have been conducted.We also specifically design an interface paradigm for pressure interaction,and make a personalized optimization for the division of pressure space with Bayesian method.These researches are of great significance for the application and development of pressure interaction on multimedia terminals.The main research contents of this paper are as follows:(1)Introduce the current state of work of pressure-based interaction devices and applications,analyze and summarize the current researches on selections based on pressure information,analyze the problems emerged during the actual interactions,introduce the paradigm shifting in human computer interaction,and propose the requirements for pressure-based selections and interface designing on multimedia terminals;(2)Design three confirmation methods for pressure input that combine traditional two-dimensional touch-screen gestures,conduct experiments to evaluate the pressure input technology with different visual feedback types,divisions,and postures,and collect users' comments and feedback;(3)Based on the features of pressure input,extend Desktop metaphor with two dimensions to a three-dimensional Desk metaphor,propose an interface paradigm LWHP for pressure interaction,and illustrate its four components with an album scenario;(4)To carry out the concept of natural interface in the field of human-computer interaction,propose an optimization algorithm for pressure space division using Bayesian method,which predicts users' input according to their previous input,to fit users' input habits,optimize the division of pressure space for individuals,and enhance their experience.