A Study And Preliminary Application On Constructing A Core Competitiveness Evaluation Index System For Undergraduate Nursing Training Based On The CIPP Model

Objective:This study uses the CIPP evaluation model as the theoretical basis to construct an evaluation index system for the core competitiveness of undergraduate nursing talent cultivation,initially applies the evaluation index system and analyzes its application effect,provides an objective assessment tool for the core competitiveness of undergraduate nursing talent cultivation,and promotes the cultivation of core competitiveness of talent cultivation in undergraduate nursing institutions as a reference.Methods:This study is divided into two main parts.The first part uses literature analysis,semi-structured interviews,Delphi method and hierarchical analysis to construct an evaluation index system for the core competitiveness of undergraduate nursing training.In the second part,the comprehensive scoring method and the expert group meeting method were used to make preliminary applications of the constructed evaluation index system.1.Literature analysis: review the domestic and foreign literature related to nursing undergraduate talent cultivation,evaluation standards of higher nursing education and core competitiveness of talent cultivation,combine the national standards of teaching quality of nursing in China and the comprehensive evaluation index system of nursing undergraduate majors in some provinces,extract variables about four aspects of background evaluation,input evaluation,process evaluation and result evaluation based on the CIPP evaluation model,and initially The evaluation index system of core competitiveness of nursing undergraduate talent cultivation is formulated.2.Semi-structured interviews: The research team interviewed university teachers and medical and nursing staff from tertiary general hospitals to understand their understanding of core competencies of nursing students,core competitiveness of nursing colleges and clinical needs,and to further supplement and improve the core competitiveness evaluation index system of undergraduate nursing talent training.3.Delphi method: Based on the nadir criteria,experts in relevant fields were selected for 2 rounds of correspondence,and the core competitiveness evaluation index system of nursing undergraduate training was determined after adding,reducing and modifying the evaluation indexes by combining the experts’ opinions and inclusion principles.4.Analytic Hierarchy Process: The analytic hierarchy process is adopted and Yaahp10.3 software is used to calculate the weights,combination weights and consistency coefficients of indicators at all levels.5.Comprehensive scoring method: The weighting and multiplication methods of the comprehensive scoring method were used to construct a comprehensive evaluation model,calculate the evaluation value of indicators at all levels and the comprehensive evaluation value,and conduct a quantitative evaluation of the core competitiveness of the nursing professional training of the 2 undergraduate institutions.6.Expert group meeting method: Experts in relevant fields were selected to qualitatively evaluate the core competitiveness of the nursing professional training of the two undergraduate institutions.7.Statistical analysis: An Excel database was established,and two persons were responsible for collating and entering the collected data,and data analysis was conducted using SPSS 26.0.The measurement data were described by mean and standard deviation;the count data were described by frequency and percentage.The motivation of experts was expressed by the effective return rate of the expert correspondence questionnaire;the degree of authority of experts was expressed by the expert authority coefficient;the degree of coordination of experts’ opinions was expressed by the coefficient of variation and Kendall’s harmony coefficient.Results:1.Literature analysis: A total of 59 literatures were included,and based on the CIPP model,four primary indicators of background evaluation,input evaluation,process evaluation and outcome evaluation,12 secondary indicators and 62 tertiary indicators were identified for the evaluation index system of core competitiveness of nursing undergraduate talent training.2.Semi-structured interviews: A total of 10 teachers of teaching and teaching management in universities and medical and nursing teaching managers in tertiary hospitals were interviewed,and the interview data were collated and analyzed to add "the number of model courses on curriculum thinking and politics","laboratory area" and "teacher ethics" to the original indicators.The interview data were collated and analysed,and 12 tertiary indicators were added to the original indicators,including "number of model courses in curriculum thinking and politics","laboratory space" and "teachers’ moral integrity".3.Delphi method: The subject group invited 21 experts,and the final number of experts participating in the two rounds of correspondence was 19 and 18 respectively,the effective questionnaire return rate was 90.48% and 94.74% respectively,the expert opinion rate was 73.68% and 22.22% respectively,the expert authority coefficient was 0.840 and 0.845 respectively,and the Kendall harmony coefficient was 0.182 and 0.244 respectively,and all of them were statistically significant(p <0.01).At the end of the first round of correspondence,8 Level 3 indicators,including the number of nurses in A3-1,the ratio of doctors to nurses in A3-2 and the rate of students meeting the physical fitness test in D1-3,were deleted,10 new Level 3indicators were added,2 Level 2 indicators and 8 Level 3 indicators were combined,and 5 Level 2 indicators and 15 Level 3 indicators were revised.After the second round of correspondence,3 Level 3 indicators were deleted and 5 Level 3 indicators were revised.The finalized CIPP model-based core competitiveness evaluation index system for nursing undergraduate training,which includes 4 primary indicators,11 secondary indicators and 68 tertiary indicators for background evaluation,input evaluation,process evaluation and result evaluation.4.Hierarchical analysis method: the weights of the primary indicators are:background evaluation(0.106),input evaluation(0.164),process evaluation(0.448)and result evaluation(0.283);the top 3 weightings of the combination of secondary indicators are: curriculum construction(0.179),teaching quality assurance(0.179)and graduate quality(0.158);the weightings of the combination of tertiary indicators The top 5 are: satisfaction of teaching by current students(0.054),social recognition(0.042),degree of support of course content to graduation requirements(0.042),Graduate Employment Satisfaction(0.042),and level of intelligent teaching(0.037).The consistency ratio CR of indicators at each level ranged from 0.000 to 0.052,all<0.1.5.Combined scoring method:The evaluation values of 28 Level 3 indicators such as the number of first-class courses in 5 categories and the pass rate of Grade 4and 6 of U1,the evaluation values of 6 Level 2 indicators such as course construction and honours power,and the evaluation values of 3 Level 1 indicators such as input evaluation and process evaluation are all greater than those of U2,and the final overall evaluation values of U1 and U2 are 3.8 and 0.3 respectively,and the core competitiveness of U1 is greater than that of U2.6.Expert Panel Meeting Method: The experts agreed that U1 has a better reputation in the community,a more "international" perspective in its training objectives,a more flexible,practical and avant-garde curriculum,a better quality assurance mechanism and stronger core competencies for nursing students.In all aspects,U1’s core competencies are greater.Conclusion:1.The core competitiveness evaluation index system of nursing undergraduate training constructed in this study includes 4 primary indicators,11 secondary indicators and 68 tertiary indicators,including background evaluation,input evaluation,process evaluation and result evaluation.The construction process is more scientific and reliable,and the indicator system has some practicality.2.The evaluation index system constructed in this study has been applied through the initial validation of 2 institutions and has certain evaluation effects,which can be used as an evaluation tool for the core competitiveness of undergraduate nursing professional talent training.