Design And Development Of 3D Geometric Modeling Software Based On Multi-mode Integration And Human-computer Interaction

The continuous development of computer technology has changed the way of Human and machine interaction,and the Multi-Modal human-computerinteraction(MMHCI)technology has also taken the train of The Times and achieved rapid development.The development of man-machine interaction is mainly reflected in the change of interaction concept and the upgrade of interactive equipment.More and more human-computer interaction not only facilitates people’s life,but also provides new ideas for the development of engineering design.Traditional CAD modeling software has always adopted the interactive mode of "keyboard + mouse" to express the design intention.This interactive mode relying on the high-frequency operation of hands has been continued up to now,which is difficult to support the rapid generation of current innovative design schemes.Therefore,the study of efficient human-computer interaction driving 3D modeling engine to achieve simple,free,intuitive,natural,flexible,efficient,safe and reliable man-machine modeling provides a new idea for the realization of the development of next-generation CAD software.In this paper,the human-machine interaction technologies of gesture,speech,eye movement and electromyography are studied in depth,which lays a technical foundation for the realization of multimode fusion human-machine interaction 3D modeling software,and proposes a human-machine signal fusion decision method based on synchronous acquisition.The initial modeling provided by EMG,the mouse movement controlled by eye movement,the signal instruction of coordinate operation information converted by gesture and the specific parameter determined by voice were integrated to drive the geometric modeling engine for modeling.Secondly,the open source Open Cascade 3D geometric modeling library is deeply studied,and the multi-mode integrated human-computer interaction 3D modeling software is designed and developed,which realizes the multi-mode human-computer interaction modeling such as gesture,voice,eye movement,etc.The software covers the basic functions of traditional CAD graphic construction,Boolean operation,view switching,feature operation and so on.Finally,the feasibility and effectiveness of the software design and development are verified by modeling the multi-mode human-computer interaction of typical equipment.Through the multi-mode integration of human-computer interaction technology and modeling software proposed in this paper,it innovates the human-computer interaction way of future industrial software,gets rid of the shackle of traditional "keyboard + mouse",A new method of man-machine modeling is proposed,and has important reference value and practical significance.