Intelligent Tutoring System Evaluation Index System Construction And Application

With the development of artificial intelligence technology and its application in the field of education,the deep integration of artificial intelligence technology and education is promoting innovation and development in the field of education.Intelligent tutoring system is a computer-aided teaching tool based on artificial intelligence technology,with adaptive,interactive and personalized features.Due to its wide application in the field of education,the evaluation of intelligent tutoring system becomes more and more important.This study aims to construct an evaluation index system for intelligent tutoring system and provide a scientific basis and method for the evaluation of the system.This study is mainly divided into three stages:in the first stage,the characteristics and shortcomings of existing relevant indicators are sorted out through literature research method,and the main dimensions of intelligent tutoring system evaluation and preliminary selected evaluation indicators are determined by literature analysis method;in the second stage,the intelligent tutoring system evaluation indicator system is constructed,and the indicators are weighted by Delphi method and hierarchical analysis method;in the third stage,the evaluation indicator system is applied to The third stage applies the evaluation index system to evaluate three foreign intelligent tutoring systems,judges the advantages and disadvantages of the system from the learners’ perspective and puts forward relevant suggestions for the development of intelligent tutoring systems in China.This study has achieved certain results as follows:(1)By combing existing researches,combining with theoretical researches in the field of user experience and summarizing the index system of related researches,an evaluation index system of intelligent tutoring system containing 7 primary indexes and 34 secondary indexes is initially established from seven aspects:information architecture,domain knowledge,teaching and learning,learning effect,human-computer interaction,usability and ease of use.(2)In order to improve the scientificity and applicability of the constructed intelligent tutoring system index system,this study combined the Delphi method and invited several experts to rate the importance of each index in the initially established evaluation index system and make suggestions.The weights are assigned to the primary and secondary indicators respectively through the hierarchical analysis method.(3)Based on the evaluation index system of intelligent tutoring system constructed in this research,three international classical intelligent tutoring systems were selected and evaluated by this evaluation index system.Through coding scores,the scientificity and feasibility of this evaluation index system are verified,and the performance of the three intelligent tutoring systems in various aspects is also evaluated.The study is of great significance to the development and application of intelligent tutoring systems in China,which can promote the improvement of their educational effects and also provide an effective method for evaluating the application of artificial intelligence in education.