The Design And Validity Test Of Computer Adaptive Testing Based On The Standard

Educational evaluation is the baton of educational development.It is an important link in the new era to carry out the task of moral education,promote the scientific development of education,and cultivate high-quality personnel.Deepening the reform of educational evaluation in the new era and solving the current educational dilemma are the tasks entrusted by the Times.It should be the fundamental way to reform traditional ideas and educational evaluation to give full play to the maximum value of educational evaluation from the perspective of promoting students’ competency development.The idea of evaluation based on standard adheres to the student-oriented quality evaluation,and the computer adaptive test based on the item response theory is conducive to achieve accurate evaluation of personalized competency level.How to combine the two to design,develop and apply the computer adaptive test based on standard,give full play to their excellent characteristics,and provide solutions for promoting students’ competency development,realizing teaching value and deepening the reform of teaching evaluation,have become the main problems of this study.Under the guidance of standard-based test’ thought,item response theory,competency theory and other theories,this study takes the assessment of normal university students’ instructional technology competency as an example,synthetically applies qualitative and quantitative research methods,and carries out study on computer adaptive test based on standard including three aspects: design,development and how to work.On the basis of system integration and construction of computer adaptive test based on standard,a method system for designing,developing and applying computer adaptive test based on standard is developed.From the perspective of solving the research problem,taking the assessment of instructional technology competency of normal university students as an example,this study is mainly divided into three parts.Firstly,the design of computer adaptive test based on standard.The design of computer adaptive test based on standard includes the design of curriculum standard and test items.First of all,combining with the idea of "student-centered,output-oriented and quality-oriented" and starting with "what have learnt" for the basis of standard-based test,the learning results are determined by constructing the cultivating objectives of the course—frame of instructional technology competency of normal university students,which to guide the compilation of curriculum standard.The curriculum standard of "Modern Instructional Technology" for normal university students is compiled in reverse based on the learning results of competency,so as to achieve an effective integration of "what to learn"(content standard)oriented by content and "what have learnt"(performance standard)driven by quality.From perspective of standard-based tests,the content and cognitive requirements of curriculum standard are framed by the table of specifications.According to the requirements of Bloom’s instructional goal,the test items of cognitive learning results and emotional attitude learning results are compiled as well as the contextualized testlet of project to reflect curriculum standard requirements for contents and objectives of the test’ carrier which are items in order to achieve the integration of teaching,learning and evaluation.Then the quality of these items are reviewed and made some correction to form items used in the computer adaptive test based on standard.Secondly,the development of computer adaptive test based on standard.In this study,the multi-dimensional item response model and testlet response model are selected according to the dimension of competence level and type of test items.Then by checking the fitness of the model and data,and the differential item functioning,an item bank is built which items’ parameters are calibrated.Combining the thought of standard-based test,the study reviews the breadth,depth and balance of the distribution in content and objective from the alignment of item bank and curriculum standard using the analysis framework of Webb’s alignment.Then,the algorithms are selected for developing computer adaptive test.the algorithm of maximum likelihood ability estimation and the terminative rule of fixed length are used in this study.In addition,the item selection strategies to ensure the measurement accuracy and constraint balance of content and objective is the key to comprehensive evaluation on“what have learnt” of the subjects,and is also a necessary condition to meet the requirements of standard-based tests whose content and objective are balanced.In this study,the item selection strategy of mutual information combined with shadow test is selected.Finally,the cut-off scores of the computer adaptive test based on the standard is set by using the Bookmarks method to match the requirements of performance standard.Thirdly,the validity test of computer adaptive test based on standard.The reliability and validity of computer adaptive test are analyzed based on standard and surveys the customer satisfaction in order to test the validity of measuring tool and results.Then,based on evaluation data mining deeply,the persona of normal university students’ instructional technical competency level is paint respectively from the angle of the group,individual and professional,and the characteristic of the persona is summarized,which to interpret the validity of measuring results.Afterwards,following the ideas of "assessment is to improve",this study carries out application of measuring results’ validity.The score report for normal university students and the diagnosis report for teachers are designed respectively according to the competency level persona,and the sample reference is given which can achieve the goal of providing diagnostic feedback to different people with standard-based tests.Based on the problems reflected from the evaluation data,this study also puts forward suggestions to improve the performance of normal university students and teachers respectively.In terms of normal university students,they should change their attitude and improve their learning motivation from their thought,and improve their performance and construct independent learning strategies in action.At the same time,the suggestions to teachers are the fundamental change of teaching concept,the cultivation strategy of transforming knowledge into wisdom and the differentiate precision instruction.This study hopes to provide scientific and feasible methods and paths for deepening the evaluation of higher education in the new era,promoting the competency cultivation and performance improvement of higher education personnel through the research results of computer adaptive test based on standard,which really plays the role of guidance,identification,diagnosis,regulation and improvement of educational evaluation.