Discussion And Research On The Selection Method Based On Retrospective Evaluation Of Peer Review Expert

Objective(1)Through classifying the evaluation index of the expert peer review by literature research and the basis of the project,discuss and explore the retrospective index of selecting the appropriate experts.(2)Based on the demand of management and the practical meaning,we will explore the methods of selecting the most consistent experts based on the retrospective evaluation of experts.Methods(1)Literature research method:This study has consulted the relevant references of peer review expert evaluation and peer review expert selection,and then classify the relevant index,and analyze the correlation using the "expert selection","expert evaluation","peer review" as the key words in the Chinese and English literature library.Using the expert review data and the relevant experts’ evaluation index to make the simulation evaluation,and select the peer-reviewed experts in the established expert library on the basis of the actual research area of experts.(2)Expert meeting method:Verifying the feasibility of retrospective evaluation index by the expert meeting method,meanwhile using the review data to verify the index which can reflect the different aspects of the various indicators of reliability,then explore the rationality and application of the overall merit,and dicusse the methods of experts’selection based on the retrospective selecting.(3)Empirical approach:This study will use the evaluation data in the process of evaluating the project to proverb the feasibility and reliability of selecting the experts’methods.Results(1)The study and creating of expert peer review retrospective evaluation index.Following the principal of avoiding the similar meaning,the correlation among the indexes,and expert consensus by literature review,the study has summarized,sorted and classified peer review indicators.In this study,we will evaluate the peer experts from the voting dimension and the score dimension.The indexes of voting dimension are consistency coefficient;The indexes of score dimension are cumulative horizontal discrete rate、system error index、score stability index.(2)Using the selecting indexes to select experts.Based on the demand of management and practical meaning of indexes,we will discuss the methods of retrospectively selecting the experts.From the voting and score dimension,we will choose the correct experts to evaluate the project.(3)Using the star to select the experts.Applying the classifying of the voting consistency or the other indexes and the principle of the expert star,we will carry out selecting experts based on the experts’ stars.Conclusion This study used the evaluation data of the expert review,and then calculate the relevant indicators of experts’ selection.We will select the peer experts contrapuntally to evaluate the projects,and using the empirical data to prove the feasibility and rationality of retrospective choosing experts.