Research On Visualization Methods For Analyzing Pilot's Visual Saliency

Visual saliency is a relatively mature technology in the visual attention mechanism.The sample applied is the data of the eye's eye movement trajectory driven by a specific scene or a task.Therefore,the analysis of eye movement trajectory data is particularly important for studying visual saliency.In the field of civil aviation,pilot visual saliency refers to the manifestation of the pilot's visual attention when performing a flight task.Using eye movement data to analyze the visual saliency of pilots can accurately understand the process of cognitive difficulties in pilot training and provide powerful data support for pilot training evaluation.However,with the increase in the size of data that can be collected,simple statistical analysis of data is not only time-consuming and laborious,but also difficult to give play to the initiative of the analyst.In view of the above problems,this paper combined with the characteristics of pilot eye movement data,proposed a visualization method that can reflect the visual saliency of the pilot,and designed and implemented a relevant visual analysis system to help analysts analyze the visual saliency of the pilot more effectively,as follows.Firstly,from the perspective of analysts,to solve the problem of traditionally dividing interest areas based on the visualization method of interest areas,a visual analysis method of visual saliency based on user-defined interest areas is proposed.Firstly,a user-defined view of interest area is designed to help analysts reasonably divide the research images according to specific analysis tasks and improve the analysts' initiative in data analysis;Then,three views of participant comparison,participant grouping,and overall overview are designed to help analysts analyze the participants as a whole;Finally,two detailed analysis views of the participant overview and key fixation points are designed to enable the analyst to analyze the participants from the overall to the details,Which reduces the thinking of the solidified interest area in the analysis process,improves the analysis and reasoning ability of the data,and increases the initiative and depth of eye movement data analysis.Secondly,considering the evaluation index,in order to solve the problem that the existing visual analysis methods of eye movement data are difficult to dynamically and visually evaluate the training effect of the pilot,a dynamic visual evaluation method of training effect based on the visual saliency of the pilot is proposed.Firstly,an eye movement data evaluation model of fixation efficiency,fixation accuracy and relevance is proposed,and an evaluation index view is designed to provide real-time quantitative numerical support for analysts to analyze the data;then,a spatiotemporal mode view is designed to help detailed analysis of the analyst from the whole to a single participant;finally,the system settings view is designed.By displaying participant information,downloading real-time monitoring charts,selecting AOI,updating time,controlling system operation and other interactions,improve the accuracy and real-time performance of the assessment.Thirdly,the visual analysis system embodying the above work is designed and implemented,and the visual analysis system is introduced in detail through cases,which proves the practicability and effectiveness of the method.The results show that the first method increases the analyst's initiative in analyzing data,supports the analyst's detailed analysis,and increases the multi-angle of the analyst's data analysis;the second method increases the operability of analysts and improves the accuracy and real-time performance of analysts in evaluating pilot training.Finally,it summarizes the full text and looks forward to the next step.