Objective:To construct a new evaluation index system for quantitative analysis of academic quality of journals and providing a reference for the quality of academic journals.Methods:Initial evaluation index and periodical information sources were from the 2014 edition of Chinese Journal Citation Report (published edition). By the recommended index method, principal component analysis and R clustering analysis method were used to select the initial evaluation index, resulting in three kinds of new evaluation index systems. The academic quality of preventive medicine journals, which were based on initial evaluation index system and three kinds of new evaluation index systems were studied by using rank sum ratio method. Based on the ranking results of the initial evaluation index system, the correlation between the initial evaluation index system and three kinds of new evaluation index systems were adopted by using spearman rank correlation. If the new evaluation index system had a high correlation with the initial evaluation index system, the initial evaluation index system could be replaced by the new evaluation index system. In order to further verify the feasibility of the new evaluation index system, the Kappa test was used to compare the results of the sorting of the results and assess whether the journals were the core journals.Results:The initial index system including impact factor, total citation frequency and the citation rate 17 bibliometric indicators, the recommended index method, principal component analysis method and R cluster analysis were to form three new evaluation index systems. Spearman rank correlation analysis showed that the ranking results of journal academic quality based on the recommendation index method and the ranking results based on the initial index system had a high correlation(r=0.701, P<0.01). To further verify the consistency of the results of the new evaluation index system based on the journal ranking and the consistency of the journal is the core journals, the Kappa value is 0.506, which has a moderate consistency. The new index system can replace the initial index system to evaluate the academic quality of preventive medicine journals. The new index system includes five indexes, that is, total citation frequency, impact factor, the ratio of fund papers, the citation rate and the average citations number.Conclusion:This study used the recommended index method to construct a new evaluation index system which was composed of five indicators, that is, total citation frequency,impact factor, fund paper ratio, the citation rate and average citation number, and so on. Based on the initial evaluation index system, the rank sum ratio method and the method based on the recommended index method for the prevention of medical journals academic quality of the empirical research, the results of the two methods of evaluation results had good consistency. That rank and index method recommended ratio method could replace the evaluation index system based on the initial rank and ratio method based on. |