Research On The Evaluation Index System Of The Implementation Effect Of My Country's Medical Artificial Intelligence-related Policies

Objective:Through the establishment of an effect evaluation index system,the use of literature and policy research methods to analyze the implementation effects of related policies,combined with relevant domestic and foreign research and the opinions of consulting experts,determine the artificial intelligence related policies issued by China in the medical and health field.Evaluation index of implementation effect;weighted assignment of indicators at various levels using tomographic analysis method,and finally a complete evaluation index system of the implementation effect of China's medical artificial intelligence-related policies is finally established,and then the subsequent development of artificial intelligence-related policies in the medical and health field Provide lessons.Methods:(1)screening index content and determining its connotation through literature research method,and initially constructing an index system framework including multi-level indicators;(2)combining policy research experts and scholars,medical AI enterprise managers,and hospital AI product users The results of the in-depth interviews,based on the full integration of expert opinions,continued to revise and improve the preliminary evaluation index system;(3)conducted two rounds of Delphi expert consultations using the expert consultation method to further screen,modify and Perfect;(4)Use the analytic hierarchy process to determine the weights of indicators at all levels to form a more scientific indicator content and weight of the implementation of the medical artificial intelligence policy.Results:(1)Through literature and policy research,the five components of the evaluation of the effectiveness of the implementation of medical artificial intelligence policies were identified:scientific research projects,scientific research results,talent training,industry development,and product application;(2)two rounds of expert consultation respectively 13 experts in related fields participated in the survey.The recovery rates of Delphi's expert consultation questionnaires were all 100%,and the expert authority coefficient was 0.780.For the other two rounds of expert consultation,the overall coordination coefficient of the indicators,the P value of the significance test were all<0.05.(3)After discussions by the research team,according to the index selection criteria and expert opinions,the evaluation indicators for the implementation of medical artificial intelligence-related policies were determined,including five first-level indicators of scientific research projects,scientific research results,talent cultivation,industry development,and product application.,And the National Natural Science Foundation of China's project establishment,the number of patent applications,the number of university openings,the number of researchers,the regional distribution of talents,the size of industry investment and financing,the number of companies with medical artificial intelligence as their core business,medical artificial intelligence application demonstration projects 25 product indicators such as product application range,diagnostic accuracy,convenience of medical treatment,and medical care workload.(4)Use the analytic hierarchy process to calculate the weight of each index at each level.The ranking of the first-level indicators is:talent training 0.2424>industry development 0.2203>research results 0.1860>product applications 0.1758>research projects 0.1755.Conclusions:This study has constructed an evaluation index system for the implementation of China's medical artificial intelligence-related policies,which consists of five first-level indicators of scientific research projects,research results,talent cultivation,industry development,and product application.Follow-up artificial intelligence related policies can be used for reference in the formulation of medical and health fields.