Research Of Pen-Like Haptic Interactive Technology For Mobile Terminal

Mobile terminals, as fast-growing personal computing and communication systems, have developed into an intelligent stage in recent years. However, in mobile field, human-computer interaction still relies on visual and auditory interaction. It has great limitations in haptic interaction. Haptic interaction as a new human-computer interactive technology allows the operator to touch, feel and manipulate virtual objects with active exploration in virtual environments, so that the operator will have an immersive experience. Haptic interactive technology can greatly enhance the quality of the human-computer interaction and extend the range of application areas and beneficiaries. Therefore, haptic interactive technology for mobile terminals has broad application prospects and market value.In consideration of the shortcomings of existing mobile haptic interaction, this thesis designs a novel pen-like haptic interactive system for mobile terminals. The system consists of two kinds of pen-like haptic devices and a software application based on Android system. One of the pen-like haptic devices is based on electromechanical structure and the other one is based on piezoelectric ceramics. This novel system is mainly used for image hapic interaction on mobile terminals. That means when operator uses the pen-like haptic devices to slide on an image, the operator will get spatial information of the image by haptic interaction, including the height information of each pixel and the edge information of the image.Key techniques and innovations of this project are:(1) This system can express height and edge information of an image by pen-like haptic devices. Two diffierent kinds of techniques have been designed to express height information of an image. One utilizes elecromechanical structure to produce force feedback and the other one uses the precise piezoelectric vibration to produce tactile feedback. What’s more, the image edge information is expressed by a linear resonant actuator. (2) A three-axis accelerometer is used to detect the gesture of haptic pen. A feasible model is established in 3D space so that the position and gesture of haptic pen can be tracked in real time. (3) Software based on Android system is developed. The software utilizes shape from shadow algorithm to extract the height of each pixel and Sobel algorithm to detect the edge of each object in an image. And Otus algorithm is used to adaptively calculate the threshold of image binarization method. Finally,3D view is built with OpentGL ES toolkit to show the visualizing 3D shapes of the image. (4) Both of pen-like haptic devices use buletooth technique and rechargeable battery to achieve miniaturization and portability. The developed software has low algorithm complexity and can be adapted to different sizes and resolutions of mobile terminals.