Research On Performance Evaluation Methods Of Automatic Target Recognition System

Automatic target recognition(ATR) has become an important part of many advanced weapon systems. At all times, many experts and scholars have been paying their attention to the research on those technologies related to ATR system. Thereinto all the research work, the pertinent performance evaluation of ATR is the groundwork of the ATR system development and improvement. At present, there are many problems in the techniques on performance evaluation of ATR systems used in our country because of its infantility. Orientating the military requirement of ATR performance evaluation, this thesis researches on ATR performance evaluation methods based on the outfield testing data of ATR system, and develops the "Combat Effectiveness Evaluation Tool for ATR System". All of the research work in this thesis resolves some important problems in this field. Its main contents are cited as follows:1. Researches on the evaluation method of ATR recognition rate based on the small sample size methods. Recognition rate is an important index in performance evaluation of ATR system, in engineering practice, recognition rate is often calculated based on experimentation results, if we wish to get a more satisfying confidence interval of the recognition rate index, a large amount of experimentation data are needed, which is restricted by many external condictions, and the test data we could get can not meet the need. This thesis introduces the small sample size methods into the recognition rate evaluation of ATR system, studying on the evaluation methods based on Bootstrap and Bayes method respectively, the applicability of the methods, the methods of the acquisition and convertion of priority information are researched thoroughly. These methods could improve the precision of the confidence interval of recognition rate based on ordinarily test data sample size, which are illustrated by the simulation example.2. Researches on the combat effectiveness evaluation method of ATR system. This thesis analyzes the combat effectiveness of ATR system,proposes the definition of ATR combat effectiveness, studies the decomposition of the combat process of ATR system, divides the indexes into two classes, one is called algorithm effectiveness indexes, the other is cost indexes, and analyzes each kind of index thoroughly combined with the combat process of ATR system. Besides, this thesis puts forward a series of methods which are suit for ATR combat effectiveness evaluation, the standardization methods of different kinds of indexes and the applicability of some aggregation methods are analyzed respectively.3. Based on all of the theoretic research mentioned above, the "Combat Effectiveness Evaluation Tool for ATR System" is developed. In this software, every step of the ATR combat effectiveness evaluation process is actualized, i.e. the edit environment of indexes system, the standardization methods of each of the indexes, and the aggregation methods. A flexible display mode for evaluation results is offered. The software system will be a convenient tool for ATR system evaluation.Finally, one evaluation example is analyzed using the software developed in this thesis.