Research Of Human-Computer Interaction Technology For Palm Puppet Robot

With the continuous development of emerging technologies,the field of humancomputer interaction has gradually been valued and developed rapidly.The integration of human-computer interaction research into traditional industries and the combination with traditional art in intangible cultural heritage has also been concerned and promoted by the society.As a traditional culture and art,Palm Puppet,like many other traditional culture and art forms,has also fallen into a bottleneck of development.With the rise of new and more attractive forms of entertainment,some problems of the puppet itself are gradually highlighted,which eventually leads to the danger of the inheritance of the puppet.Therefore,in view of this situation,we propose an interactive performance based on the palm puppet robot,hoping that the robot elements and interactive elements can better attract young people,so as to promote the promotion and inheritance of the traditional culture and art of hand puppet.In this paper,the interaction framework of the puppet robot is proposed,and two different forms of interaction are explained.The interaction framework of the palm puppet robot includes three main modules:acquisition module,strategy module and robot module.We use Microsoft Kinect and Leap Motion to collect the user’s limbs,gestures and other spatial information.The strategy module will design a suitable finite state machine according to the specific performance,and the finite state machine will determine the state of the robot according to the spatial information collected by the acquisition module.After the robot receives the command from the strategy module,it will finally decide how to move according to the results of its own motion computation module.This paper proposes two different forms of interaction:interactive performance and interactive game.Interactive performance adds a robot actor and interaction section to traditional performance.Interactive game focuses on the interaction with a single user,and the user controls and interacts with virtual characters through somatosensory input.In the experimental part,through the questionnaire survey and interview after the performance,we analyzed the audience and actors respectively.According to the results of questionnaire and interview,we can conclude that the interaction framework and two specific interaction methods proposed in this paper can provide smooth and good experience.