The Response Characteristic And The Eye Movement Clues Of The Audiovisual Integration

The hypothesis of this research:The asynchronous audiovisual presentation of the PPT courseware will influence the learning effect. The research used two factors within design and24participants took part in it. There are two missions in the research:one-digit mission and double digit mission. The independent variables are the time combination and position combination. The dependent variables are the reaction time (RT) and eye movement data. Experiment result indicates:1. It’s difficult to arouse the audiovisual integration when the audiovisual stimulus presented at the same time. The audiovisual integration work effectively when the audio stimulus presented500ms earlier than the visual stimulus. The synchronous of the audiovisual stimulus will tie up the cognitive resource and the audiovisual integration will decrease when the time gap between the visual and audio stimulus is more than500ms.2. Double-digit mission will increase the cognitive load and affect the information processing. In different stimulus present level, the RT increased stable and the curved shape are equidistant.3. In the single digit experiment, the reaction time correlated with the number of the fixation points. In the double-digit experiment, the reaction time correlated with the fixation duration.4. The central position stimulus is easiest to be distinguished. In the right part of the screen, especially in the right bottom position, the visual stimulus is difficult to be distinguished. When the audio stimulus presented earlier than the visual stimulus, the reaction time is short; When the audio stimulus presented later or same as the visual stimulus, the reaction time is longer.