The Relationships Between Language And Spatial Cognition Under Audio-visual Channel

In work and life, especially in the special fields such as aviation navigation, we make space judgment through the visual, auditory and tactile and other sensory channels, this process is almost inseparable from the language. Through language representation, we can determine the spatial orientation of things and determine the relative spatial orientation of two or several things, which is spatial orientation.In recent years, the visual spatial ability has become the important research area of cognitive psychology, artificial intelligence, cognitive neuroscience, and other disciplines. Visual space cognitive ability is essential for career in flight. The pilot’s good spatial cognitive skills is closely related to his professional success. Numerous studies have shown the closely relations between language and cognition in the field of visual space cognition. However, auditory spatial cognition area is lack of research by comparison to the vision.Based on the visual and auditory sensory channels, this research study the complex relationship between the sensory channel, language and spatial cognition. The purposes of the research:(1) which kind of language representation helps to make the better spatial relation judgment; (2) the visual and auditory sensory channels have any effect on spatial orientation; (3) whether sentence of referential object in front or rear’s spatial cognition process is consistent; (4) whether the spacial cognitive process of the visual and auditory is consistent.This study used 2 (space language sentence:sentence of referential object in front or rear) x 2 (sensory channel:vision, auditory sense) x 4 (time interval:Oms,50 ms, 100 ms and 300 ms) within-subject experimental design Improved the classic "sentence-graphic verification", changed relatively simple "whether or not" reaction to the relatively complex selective reaction, selected the graphic which is consistent with the sentence, the reaction increase difficulty and is close to realistic situation. Spatial orientation relation include "up, down, left and right". Through the changing time interval, we can study the working process of spatial cognitionThe results showed that:(1) On the accuracy, the working depth of auditory sense is superior to the vision. On the reaction time, vision and auditory sense show significant difference. (2) Compared with sentence of referential object in rear, sentence of referential object in front can work faster and deeper. (3) On the accuracy, with the increase of the time interval, sentence of referential object in front or rear present the consistent changing process. On the reaction time, the interaction of the sentence pattern and time interval shows significant difference. With the increase of the time interval, sentences of referential object in front or rear show the inconsistent changing process. (4) On the accuracy, the interaction of the sensory channel and time interval shows marginal significant difference. With the increase of the time interval, the correct rate of the vision and auditory sease show the inconsistent changing process. On the reaction time, with the increase of the time interval, the vision and auditory sense show a consistent change process. Reaction time show the declining tendency on the interval period of 0-300 ms.Conclusion:(1) On the accuracy, auditory sense is significantly better than vision But, on the reaction time, auditory sense is not significantly better than vision (2) sentence of referential object in front is more advantageous to the space representatioa (3) On the accuracy, sentence of referential object in front and rear show the consistent changing process. On the reaction time, sentence of referential object in front and rear show the inconsistent changing process. (4) On the accuracy, the vision and auditory sense show the inconsistent changing process. On the reaction time, the vision and auditory sense show the consistent changing process.