| The aim of our studies is to establish a new comprehensive meth-od and a corresponding computer management system to evaluate the achievements of scientific and technological professionals of health sci-ence , which can evaluate achievements of the professionals scientifi-cally, objectively, fairly and conveniently by combining qualitative a-nalysis and quantitative analysis, and hence to provide decision -making reference data for managers and decision - makers.MethodsThe procedures of our research are as follows: First, Multi - at-tribute comprehensive evaluation theory and bibliometrics are em-ployed in this research. Two - dimensional, " past" and " present" , comprehensive index system of evaluation is established, unlike tradi-tional one - dimensional evaluation mode. In the new index system, two - norm - layer indices (published papers, i.e. , "past" achieve-ments and current scientific research projects that the scientific and technological personnel are sponsoring or participating, i. e. , "pres-ent" achievements) and five - subnormal indices (the number and kinds of papers published, quotation of papers, registration of papers in the retrieving system, the levels and types of the scientific research tasks, funds on scientific research) are employed. Second, by con-sulting 250 experts in related areas, we employed methods such as an-alytic hierarchy process ( AHP) , fuzzy group decision - making theory and method, and comparison between close targets ( Gl) to determine the weights of various indices. Third, we decided the calculating for-mulas of various indices and the way of making practical measure val-ue dimensionless concerning the normal layer objects. Fourth, we de-termined a mathematical model of comprehensive evaluation from the point of view of ideal state space in two - dimensional index system and by the technique of order preference by similarity to ideal solution (TOPSIS method) , and then to evaluate the total score of the profes-sional performance of scientific and technological personnel of health science.We used Windows and Microsoft Visual FoxPro6. 0 to program management system to realize the above evaluation. This system is used in the professional technological appraisal of staff in China Medi-cal University. We compared and analysed the quantitative evaluating results by this system with the practical evaluating results by peer re-viewers.ResultsThe experts chosen are representative, authoritative, and quali-fied , which guaranted the high reliability of the results. Only a small percentage of judgment matrixes determined by them has met the con-sistency test. The least number of experts passed is 127 in four parts of question. After comparison and analysis, we confirmed the weight of indices according to the weighted average method to synthesize ranking vectors in AHP, while the experts' objective weights was ob-tained by the level of judgment matrixes constructed by specialists, that was the consistent extent of judging matrixes and the accordant ex-tent of individual priorities with group priorities. There was no statistic difference between the quantitative results by this evaluation system and the qualitative results by peer reviewers. As for each individual,the accuracy of two estimating modes is 86. 1% in group promoting senior titles and 73.2% in group promoting associate senior titles.ConclusionsThe system is scientific, objective, fair and feasible evaluation method which makes the evaluation indices easy, simplified and quan-tified , and suits the situation of China well. Also, in this system, the corresponding computer operation system is easy to operate and get popularized. In the process of appraising professional technological ti-des of staff in China Medical University, researchers have found that the results obtained by applying this system shows high accuracy when compared with the actual results. Four innovations are introduced in this dissertation: First, we improved the method of determining ex-perts ' weight coefficients... |
PDF Full Text Request