Study On New Type Of Mouse Based On Vision And Voice

Ordinarily mouse is the tradition alternation mode with hand but the people with hand deformity and game enthusiast wish to operate PC with manifold alternations. It is likely to realize mouse based on vision and word recognition with the development of CCD,CMOS image sensor's manufacture technics and image,vision arithmetic.The paper most research and realize the new pattern mouse based on vision and voice. Firstly, the paper discuss all the methods of realizing vision track arithmetic, the system use top of nose character track as cursor motion, use eyes' open and close as the operate of keystroke, use Halcon to simulate the arithmetic and realize with Visual Basic. Otherwise, the operation of keystroke can also realize with voice recognize. The paper simulate the DTW arithmetic with Matlab to create COM module, and mix-programme with Visual Basic and Matlab , then performance test. The training method of the arithmetic is simple , it's fit for system's design. Lastly, combine the vision track module and voice recognize module, and debug the whole system, note the experiment result. Application vision and voice to mouse, there is nobody research inland, and this is no doubt worth to studying. Full of marketing potential.The completed design indicated that the scheme based on vision and voice could fulfill the mouse's function, and it is fit for special persons. However, this system has been designed and completed experimentally. The following work will mainly improve and develop the arithmetic and optimize the program as well as some detail problems.