Construction Of The Training Effect Evaluation Index System For Nurse Anesthetist Based On Kirkpatrick Model

ObjectiveTo construct the training effect evaluation index system for nurse anesthetist based on Kirkpatrick model and investigate the current situation of the training effect of nurse anesthetist,the aim was to provide data support and reference basis for the training and assessment evaluation of nurse anesthetist.Methods1.Establishment of a preliminary framework for evaluating the effectiveness of nurse anesthetist training indicators.Based on the Kirkpatrick model,the response,learning,behavior,and outcome levels were used as primary indicators.Based on the literature search and combined with the semi-structured interviews of nurse anesthetist,anesthesiologists,nurse anesthetist managers and surgeons,the orientation content analysis of the interview data was carried out to form a preliminary evaluation index system framework for the training effect of nurse anesthetist.2.Construction the final evaluation index system of the training effect of nurse anesthetist.The evaluation index system of nurse anesthetist was evaluated by Delphi expert correspondence method,and experts in the field of specialty were employed to select and adjust the index system several times anonymously until the expert opinion was unified.Finally,by using analytic hierarchy process,the weight of each level and combination weight in the evaluation index of the training effect of nurse anesthetist was determined,and the final evaluation index system of the training effect of nurse anesthetist was established.3.Preliminary application of the evaluation index system for the effectiveness of nurse anesthetist training.Based on the constructed evaluation index system for the training effectiveness of nurse anesthetist,a survey questionnaire on the training effectiveness of nurse anesthetist was developed.The convenience sampling method was used to investigate nurse anesthetist who had participated in the training of nurse anesthetist.A preliminary study on the status of training effect of nurse anesthetist in China was carried out.Results1.Through literature review,semi-structured interviews,and collective discussions with the research group,a framework of 4 primary indicators for evaluating the effectiveness of nurse anesthetist training,including response,learning,behavior,and outcome level,15 secondary indicators,and 61 tertiary indicators,had been preliminarily formed.2.Two rounds of Delphi Expert Correspondence Survey were conducted and good centralized feedback was generated.The two rounds of Delphi Expert Correspondence were positive and authoritative,with effective recovery rates of 92.3%,100%,expert authority factor of 0.858,0.864,and Kendall Harmony factor of 0.214,0.173,0.148.The mean assigned to each indicator was ≥ 3.5,the coefficient of variation was ≤ 25%,and the ratio of the item score to the full score was>20%,all of which satisfy the criteria.Analytic Hierarchy Process was used to determine the weights and combination weights of various indicators,and tests for consistency were performed.Finally,the index system for evaluating the effectiveness of nurse anesthetist training with 4 primary indicators(response level,learning level,behavior level and result level),14 secondary indicators and 51 tertiary indicators was established.For the first-level indicators,the consistency ratio was CR 0.0467,with CR<0.10,Through tests of consistency in the judgement matrix,it was reported that the weights were acceptable,with the learning level and the behaviour level accounting for the largest proportion which were 0.3204 and 0.4890 respectively.A total of 14 indicators are included in the secondary indicators,among which the highest weighted values were the clinical nursing ability(0.2221),operational skill(0.1812),post-training work status(0.1428),radiation effects(0.1122),and theoretical knowledge(0.1031)of the subjects in the training.Essentially,the third-level indicators with a relatively high proportion of weight were subordinate indicators of the second-level indicators mentioned above.3.The questionnaire on the training effect of nurse anesthetist was split into four dimensions: The Cronbach’s α coefficient in the aggregates was 0.957 and the Cronbach’s αcoefficient in the indicators was 0.798 to 0.958,so the indicators had good reliability..Evaluation of the validity of the present study includes both content and structural validity.The content validity index(S-CVI)was 0.975 and the content validity index(I-CVI)of each item was 0.875 to 1.00,indicating that the content validity of this study was good.The KMO value representing structural validity was 0.960,using Bartlett’s chi-square test to approximate the χ 2 results was 11186.430,P<0.001,which was appropriate for use in factor analysis research.Exploratory factor analysis resulted in the extraction of four common factors,and their cumulative contribution rate of variance reached 60.021%.The overall indicator thus had good construct validity.According to the findings,the total score of nurse anesthetist training effectiveness scale was 207(185.75,219.00),and the total entries were equally divided at 4.06(3.64,4.29),which was higher than the average.In the differential analysis of the training effectiveness of nurse anesthetist,gender was not statistically significant(P>0.05).However,there were significant differences in the effect of age,job title,education,years worked in anesthesia nursing,and hospital level on the training effect of nurse anesthetist(P < 0.05).Conclusion1.The evaluation index system for the training effectiveness of nurse anesthetist established in this study was based on the Kirkpatrick model,which was divided into 4primary indicators(response,learning,behavior,and outcome level),14 secondary indicators,and 51 tertiary indicators.The expert opinions were concentrated,the information assigned to each indicator were true and reliable,the analysis was rigorous and reasonable,the relusts were scientific and true,and the weights of each indicator were scientific and reasonable.This provided comprehensive and objective guidance data for the training,assessment,and evaluation of nurse anesthetist.2.Based on the evaluation index system of the training effect of nurse anesthetist,the department of nurse anesthetist,the effect questionnaire,and the analysis of the status quo and influencing factors of the training effect of nurse anesthetist could provide participants and data support for the training assessment and evaluation of nurse anesthetist,which was of great significance for improving and standardizing the anesthesia system.It had certain rationality and operability in the practical application of the training evaluation of nurse anesthetist.The larger application and promotion price set.