Research On Quantitative Evaluation For Operation Performance Of Air Traffic Control

Scientific evaluation for operation performance of air traffic control is an important prerequisite and key content to working out operation optimization strategies and improving operation situations. With rapid development of air traffic flow and air traffic operation size, it’s not effective any more to evaluate operation performance of air traffic control in an increasingly complex environment by qualitative methodology based on experience. Therefore, to meet actual needs and promote scientific progress in air traffic management field, an effective path is to research on quantitative evaluation technology and methodology for operation performance of air traffic control, which is of great theoretical value and realistic significance.In this dissertation, the status and progress of the research on operation performance evaluation of air traffic control at home and abroad were wholly analyzed. In view of the current shortage of comprehensive evaluation, a systematic study on comprehensive evaluation methodology was fulfilled, and the research focus was highlighted as “comprehensive evaluation methodology for operation performance of air traffic control based on data mining”. The research aspects in this dissertation can be listed as follows:1. A general and comprehentive index system for operation performance evaluation of air traffic control was established. The proposed index system included 63 indexes reflecting 4 factors(density of air traffic flow, safety performance, efficiency performance and workload of air traffic controller); and 8 key indexes were identified considering the index difference in comprehensiveness, typicalness and maturity. By the application of factorial analysis, 3 service performance factors in air traffic control, which are density of air traffic flow, safety performance and efficiency performance, were weighted as 0.37, 0.34, and 0.29 accordingly. The results were in accordance with the real picture by fuzzy synthetic evaluation. To analyze the connotation on workload of air traffic controller, a grade assessment model based on work performance was established, by means of grey statistical evaluation method in view of functional relation between workload and work performance of air traffic controller fitted after statistical regression analysis, and the effectiveness was verified.2. A comprehensive evaluation method for operation performance of air traffic control was researched based on principal component analysis, by which the sample with high-dimensional data was processed with dimensionality reduction and evaluated with comprehensive score. Taking the Chengdu terminal area with single runway(Runway 02L) as an example, the method was proved to be feasible by Q-cluster analysis combined with experience judgement of senior air traffic controllers. The method also provided effective basis for operation optimization strategies in fields of team resource management, flexible use of airspace, and capacity-flow distribution.3. A comprehensive evaluation method for operation performance of air traffic control was researched based on back propagation network model. By network training and test, the comprehensive evaluation was fulfilled by means of artificial intelligence, which established input-output mapping relationship for all the original index information. Taking the Chengdu terminal area for example, under the condition of segregated operation on two parallel runways, a back propagation network model was set up and applied for classification evaluation. In comparison with the comprehensive evaluation method based on principal component analysis, the efficiency of the new method was proven since the evaluation results were in fairly good consistency with each other, and the improvements were achieved in aspects of keeping full original index information and strengthening classification capability. The new method also provided quantitative tools for controllers’ performance and skill assessment.4. An evaluation system for operation performance of air traffic control was developed, and the feasibility and practicability were verified. The main functions of the system included: realizing continuous index-measurement and comprehensive evaluation(comprehensive score and classification result of sample), and enriching quantitative methods for operation management by developing debriefing and statistical analysis modules. As the expanded application, the system played a role in data-supporting for such strategic issues as airspace and route planning, and airspace capacity evaluation.In the end, the dissertation summarized the research conclusions, pointed out the related deficiencies, and proposed outlooks for further study.