Construction Of The Evaluation Index System For The Competency Of Brain And Heart Health Managers

Objectives1.Establish a scientific and applicable evaluation index system for the competency of brain and heart health managers in China.2.According to the constructed evaluation index system,a self-evaluation scale of post competency of brain and heart health managers was formed,and the brain and heart health managers in China were investigated.According to the survey results,the evaluation index system was further revised and verified.MethodsPart I:Qualitative study on the construction of post competency model of brain-heart health managers.Through literature review,based on the competency iceberg model,the five key competency factors of knowledge,skills,self-concept,attitude or values,traits and motivation are combined with the characteristics of brain and heart health managers to extract relevant indicators and form a preliminary structure of indicators.Six brain and heart health managers,four nursing managers and two doctors from different regions were selected by objective sampling method to conduct semi-structured interviews.The data were analyzed by using the Colaizzi data analysis method in phenomenological research,and the interview contents were sorted out and refined to enrich the index framework and form the first draft of the evaluation index system.Part II:The construction of post competency evaluation index system for brain and heart health managers.According to the post competency model of brain and heart health managers formed by qualitative research,the entry pool of post competency indicators of brain and heart health managers is proposed.Using Delphi expert inquiry method,17 experts from 8 comprehensive Grade A hospitals in 5 provinces and cities including Beijing,Hubei,Henan,Jiangxi and Chongqing were selected for inquiry.According to the results of two rounds of expert consultation,the evaluation indicators were screened and revised to test the authority and credibility of expert consultation,and the evaluation index system of the post competency of brain and heart health managers was constructed.Part III:Verification of post competency evaluation index system of brain-heart health managers.Convert the evaluation index system of post competency of brain and heart health managers built in the second part into the self assessment scale of post competency of brain and heart health managers,and carry out two rounds of surveys on provincial or national brain and heart health managers from all regions of the country using the convenient sampling method and the electronic questionnaire(the first round of survey is conducted with the first version of the self assessment scale,and the second round of survey is conducted with the final version of the self assessment scale).According to the results of the first round of survey,Excel and SPSS were used for item analysis(critical ratio method,item analysis method),exploratory factor analysis was used to screen the evaluation index entries,and the evaluation reliability(internal consistency,half-reliability,retest reliability)was revised,so as to form the final version of the post competency self-assessment scale for mental health managers,and the second round of survey was conducted.According to the results of the second round of survey,use AMOS software to conduct confirmatory factor analysis,judge the fitting degree between the model and the actual data,and further verify the scientific and applicability of the final index system.ResultsPart I:Through literature review and combining the characteristics of brain and heart health managers,this part extracts 4 first-level indicators,15 second-level indicators and42 third-level indicators to form a preliminary indicator structure.The purpose sampling method was used to select 12 people for semi-structured interview.The interview time was 27 to 50 minutes,with an average of(37.83±7.56)minutes.Through sorting and analyzing the interview data,a total of four topics,18 subtopics and 61 characteristics of the competency of brain and heart health managers were extracted,including theoretical knowledge,operational skills,comprehensive ability and personal characteristics.Part II:In this part,the two rounds of expert correspondence were 17 and 16,with the positive coefficients of 100%and 94.12%respectively.In the first round,10 experts put forward 65 constructive suggestions,and in the second round,5 experts put forward 10constructive suggestions.The expert authority coefficient was 0.90 and 0.91respectively,and the Kendall coordination coefficient was 0.351 and 0.228 respectively(both P<0.05).The constructed evaluation index system includes four first-level indicators,16 second-level indicators and 72 third-level indicators,including theoretical knowledge,operational skills,comprehensive skills and personal characteristics.Part III:The two surveys in this part were 451 and 328,and the effective questionnaires were 424 and 315,respectively.The critical ratio(CR)in the project analysis of the indicator system is 11.242～26.322(P<0.01);The correlation coefficient(r)between each item and total score was 0.574～0.834(P<0.01);Total Cronbach’s in reliability analysisαThe coefficient is 0.987,the total half-reliability is 0.951,and the total retest reliability(γValue)is 0.522(P<0.01);In the validity analysis,the I-CVI of the indicator system is 0.875～1.000,the probability of random consistency(Pc)is0.004～0.031,and the adjusted kappa value(K*)is 0.871～1.000;S-CVI/UA is 0.931,S-CVI/Ave is 0.991;Exploratory factor analysis showed that the KMO value of the scale was 0.971 and Bartlett’s spherical testχ~2=36525.241(df=2556,P<0.001)。Try to set the extracted principal component score to"4",and use the principal component analysis method to obtain dimensions similar to the source scale after the maximum variance orthogonal rotation.The rotation has converged after 9 iterations,and the cumulative variance contribution rate is 68.370%.According to the principle of deleting and retaining items in the scale and in combination with the discussion of the research group,a total of 5 dimensions and 14 items were deleted,1 dimension was added,1item was revised,and 6 items were adjusted.Confirmatory factor analysis shows the fitting of the revised scale(χ~2/df=2.146,RMR=0.043,RMSEA=0.095,NFI=0.819,IFI=0.826,TLI=0.816 and CFI=0.826)meet the statistical requirements;The average variance of variance(AVE)of each dimension of aggregate validity was 0.625～0.741,and the combined reliability(CR)was 0.951～0.963;The square root value of AVE of each dimension in the discrimination validity is greater than the correlation coefficient value of this dimension and other dimensions(P<0.01).Finally,a competency evaluation index system of brain and heart health managers with 4 first-level indicators,12 second-level indicators and 58 third-level indicators was formed.ConclusionsThis research adopts the research method of combining qualitative research and quantitative research,and finally constructs the evaluation index system of post competency of brain and heart health managers,which includes 4 first-level indicators,12 second-level indicators and 58 third-level indicators.It has good reliability and validity,and can be used to evaluate the post competency of brain and heart health managers.It not only provides an objective basis for the selection,training,appointment,assessment and performance distribution of China’s brain and heart health managers,but also facilitates them to analyze their own gaps and lock in the improvement goals,so as to promote the development of stroke prevention and control work,promote the standardized management and construction of China’s stroke field,and accelerate the transformation of stroke management from disease treatment to whole-process health management.