Research And Application Of Somatosensory Interaction Mode For The Custom Of Traditional Wooden Houses In Nursery

With the development of technology, the interactive mode of somatosensory interaction has been applied in the field of games, medical care, education, media and engineering. The way of man-machine interaction has been developed from graphical user interface(GUI),which is mainly composed of traditional mouse and keyboard,to the natural user interface(NUI) of multi-touch technology, and then to the 3D interface of somatosensory technology. It has been gradually reducing the cognitive load of the operator. Meantime, it has been in line with the human cognitive and operational habits, polishing the nature of user interaction. However, there are some experience problems, which may reduce the satisfaction degree of operation. For example, existing somatosensory interaction actions are unable to achieve a number of complex operation of the order. Sometimes, it still needs the traditional but relatively mature interactive means like mouse, keyboard and gamepad to help finishing the process. A considerable part of the operation mode of the threedimensional sense has just copied the mode of plane multi-touch operation. Although the use of the universality of traditional interaction mode can reduce the threshold of the operation by reducing the burden of the user’s cognition and learning, in fact the interaction of natural and the purpose of satisfying the operating habits of human action have not made better progress. Somatosensory interaction has not completely abandoned the original format network interface. Taking into account of the interactional difference between the traditional operational model and the somatosensory operational model, the latter one should have its own independent user interface(In terms of visual design, it is necessary to design a natural interface according to the characteristic of human body structure, operation habits and man-machine engineering data).This paper will try to solve some problems in the mode of somatosensory interaction and do the following research based on the user experience, through the experiment of the sensor named Kinect2.0:1) Analyze the causes of false operation during the interaction. With the existing condition of Kinect sensor, according to its recognition accuracy standards for determining the trigger gesture, get a set of solutions to the problem for somatosensory interaction involving false operation.Through the established algorithm realization gestures of order system, improve the mapping relationship.2) According to the common operation of the user gestures, simplify the action language of interactive operation. By following the principle of mutual action design, achieve a set of mapping action matching the applications of presentation and customization.3) Design and optimize user interface structure for somatosensory interaction mode. And apply to the wooden houses custom applications of nation Miao and Dong. Design a high fidelity prototype of an application aimed at customizing wooden residential element components of nation Miao and Dong(Extract the traditional architectural aesthetic elements, including color, function and structure, equipped with roof, rake angle, tiles, cornices, hanging melon and other ethnic elements of architectural symbols, as well as window, door flower, bench, threshold and some other distinctive decorative elements). This practical example will strictly abide by a software product’s design process and aim at achieving the preliminary target of designing a customized application. Respectively through the steps of demand analyzing, process designing, sketching, outputting low fidelity model and high fidelity model, verify the feasibility of theory and solution.