Evaluation Of The Innovation Of Academic Papers Based On Novelty And Usefulnes

The continuous growth in the number of research outputs is a challenge to journals,research institutions and research scholars.As an important manifestation of research output,academic papers are an evaluation indicator of the academic standards,research capabilities and academic contributions of scholars and institutions.Journals need to select highly innovative academic papers from a large number of submissions in order to promote the high quality of the journal and the discipline as a whole.Research institutions and scholars need to quickly identify innovative papers and accurately access innovative knowledge to grasp the frontiers of research and topic selection in their disciplines.At present,academic papers are mostly evaluated based on the number of SCI papers,impact factor,citation frequency,etc.This evaluation method not only misleads people to do scientific research for the sake of publishing papers and the undesirable behaviour of artificial citation for the sake of increasing citation frequency,but also the evaluated academic papers may not have higher academic value.Therefore,the search for a scientific and effective evaluation method for academic papers has become a hot issue of concern for scholars.The innovative evaluation of academic papers is the basis of academic evaluation,which exists in several scientific research communication activities and occupies an important position in the decision-making of scientific research awards,title evaluation,and the allocation and application of scientific research resources.A scientific and effective evaluation of the innovativeness of academic papers can better guide scientific research work,improve the quality of scientific research results and promote the development of science and technology.In order to deeply reveal the academic value of scientific research achievements,this paper evaluates the innovation of academic papers from two dimensions of novelty and usefulness.The main research contents are divided into the following four parts:(1)This paper discusses the current research situation of the evaluation methods of the innovation of academic papers,analyzes the connotation of the innovation of academic papers,and designs the research route and methods of this study.(2)Use the rule extraction technology to obtain the question and method knowledge elements in the abstract text,design Python programming code to obtain the question-method combination of a single paper,and count the frequency of relevant words and their combination.(3)The novelty measurement formula based on time and co-occurrence relationship is designed to measure the novelty of academic paper issues,methods and their combinations respectively,and the validity of the evaluation method of academic paper novelty is verified by using the burst word detection function of Cite Space.(4)Using the identified novel papers as the data source and the weighted citations as the evaluation index for the usefulness of academic papers,we construct strategic coordinates for evaluating the innovativeness of academic papers based on novelty and usefulness.The innovative papers are identified according to their distribution in the strategic coordinates.Through literature analysis,the scientificity and reliability of the innovative evaluation method proposed in this paper are tested.The empirical study found that the novelty analysis method of academic papers based on the problem and method knowledge element was able to identify the innovative content of the papers and analyse their degree of innovation.The novelty and usefulness-based academic paper research makes up for the shortcomings of a single perspective in existing research by focusing on both the practical distinction of knowledge,which enables innovative content to be expressed visually,and the quality and value of new knowledge,which enables innovative academic papers to be identified with accuracy.The knowledge-based academic paper research method proposed in this study is practical and operable,and is an enrichment of academic evaluation methods and a positive guide to the development of innovation in the disciplinary field.