Construction And Empirical Analysis Of Evaluation Index System For Training Efficiency Of Assistant General Practitioners Based On Kirkpatrick Model

Objective: The level of primary medical service is low in our country,facing the situation of poor primary medical resources and a death of general medical personnel.It is essential that general practitioners,as the primary provider of medical services,enhance their education and fully capitalize on the significant part of assistant general practitioner training.The purpose of this study is constructing the index system to evaluate the training effect of assistant general practitioners based on the Kirkpatrick model,so as to provide training effect evaluation tools for each training base in carrying out the training of assistant general practitioners.Method: Indicators that meet the training standards and post requirements of assistant general practitioners are screened by literature analysis and qualitative interview.An index system of assistant general practitioner training,based on the principle of index system construction,is initially established to evaluate effect..The effect evaluation index system is constructed through the utilization of a two-round Delphi method.Employing an analytic hierarchy process,the weight was calculated.Trainees from grade 2019 to 2021,who had been trained as assistant general practitioners in Liaoning Province,were sent an online questionnaire survey in October 2022.Project,reliability and validity analysis were carried out on the reaction level to test the scientific and validity of this index system.Results: 1.Based on the Kirkpatrick model,the effectiveness evaluation index system of assistant general practitioners training was composed of four first-level indicators,12 secondary indicators and 51 third-level indicators.There were 20 experts participating in the Delphi method,and the enthusiasms of them ware 80% and 100%.Kendalll’s concordance coefficient of each index was significantly different(P<0.05),with the coefficient of authority being 0.88.2.The score of the two rounds of Delphi method is between 4.30 and 4.90;The coefficient of variation is between 0.06 and 0.22.The weights of four first-level indicators: reaction level(0.0948);Learning level(0.2175);Behavior level(0.3475);Result level(0.3403)by analytic hierarchy process.The top three secondary index of weights are: personal effectiveness(0.6897),application ability(0.6667)and practical skill level(0.4640).3.In this study,online questionnaire survey was conducted to investigated the situation of the response evluation of the trainees in Liaoning Province.A total number of questionnaires collected was 226,The project analysis results revealed a significant distinction between all index items(P<0.05),and the correlation coefficients between items and total score were 0.694-0.932(P<0.05)except for one item which was 0.103.(2)Reliability analysis: Cronbach’s coefficient of the reaction level was 0.984,and the second-level Cronbach’s coefficient ranged from 0.867 to0972,indicating that the results were reliable.(3)Validity analysis: The cumulative variance contribution rate of factor analysis was 74.130%.The results of analysis showed that the factor structure of the reaction level can conform to the single dimension structure,which indicates that the factor structure is reasonable.4.Evaluation at the reaction level: Students have a high satisfaction during the training,with the highest score of training participation.The satisfaction of training activities and course design ranked second and third,and the score of training security was the lowest,with 3.11 points.18.4% of the trainees believed that the The wages and welfare treatment during did not The support them.In terms of training teachers,the score of each index is above 4.5,indicating that the level of teachers in each training base up to a satisfactory level.Conclusion: According to the theory of Kirkpatrick evaluation model,the evaluation index system of the training effect of assistant general practitioners was formed in this study,which concluded a partial dimension test and a empirical research.The results showed that the index system is scientific and reliable,and the trainees in Liaoning Province have a positive attitude on the training.An efficient evaluation tool for enhancing the assessment of assistant general practitioners’ training effectiveness can be provided by an evaluation index system.It has theoretical and practical for improving the training scheme of assistant general practitioners and the implementation of effect evaluation for general practitioners.