Multi-channel Human-computer Interaction And Integration Algorithm

In order to change the traditional computer-centered mode of HCI (Human-Computer Interaction) the Multimedia technology is used in computer. And it makes the interface of output better. On the other hand Multimodal technology is changing the interface of input. In that condition Multimodal technology is studied in this thesis. The structure of the task is developed when we design the Multimodal integration strategy. The task structure with complex object structure is proposed. It makes programming easier and Multimodal integration module more independent from application. In the thesis there are two integrating strategies. The first strategy is implemented according to the thought of task-oriented and "event relation matrix" is proposed to make programming more easily. In order to avoid the shortcoming that errors often happen at creating task slot the second strategy is based on task recognition. This strategy can make full use of the uses' information. And we can get something from the integration to help fill the task slot. That strategy leads a better result. At the end of the thesis we talk about the future of HCI.