Evaluation Design Of Students’ Scientific Literacy With Digital Science Experiment

As a key factor of students’ scientific level,it is of great Significance to evaluate scientific literacy in a standardized and scientific way.With the advancement of "educational informationization",the curriculum standards of physics in junior high schools and 《the Opinions on Strengthening and Improving Experimental Teaching in Primary and Secondary Schools》issued by the Ministry of Education emphasize the improvement of traditional experimental inquiry mode and call for the application of digital experiments in compulsory education.This paper tries to provide a local scientific literacy evaluation design process,and also designs a scientific literacy evaluation question with digital experiment as the framework with the theme of "energy change",which is used to evaluate the scientific literacy of local 15-year-old middle school students.First of all,this paper makes a comparative analysis of the evaluation framework of scientific literacy of PISA,NAEP and TIMSS,clarifying the concept of scientific literacy and the design logic of the evaluation framework.In the design process,ECD model was used to decide the evaluation presentation.This evaluation is designed with the theme of "energy change" involved in the field of "material science" in junior high school.In order to test the feasibility of evaluation,this paper selects some questions in the field of "material science" in PISA and some questions related to the evaluation theme as calibration.In terms of the compilation dimension of test questions,it refers to the division of scientific literacy dimension of PISA in order to maintain the internal dimension consistency.SPSS was used for correlation and independent sample tests,meanwhile,Many facets Rasch model was combined to analyse the internal structure and reliability of the designed test paper,in order to further examine the scientific nature of the questions.The scientific literacy evaluation based on digital experiment is verified to be reasonable through comparative analysis with PISA grading.Through many facets Rasch model analysis results,in terms of internal validity analysis,students’ ability level and test difficulty in this evaluation scheme have a good overall matching.Moreover,the differentiation degree of the test questions is good,the reliability of the test questions and students is at a good level,and the score transition of the test questions is good,and the probability distribution of students’ ability performance is uniform as a whole.New evaluation scheme and PISA school standard questions in science literacy has good internal and external dimantion correlation.In the evaluation results,the total scores of PISA standardized tests are highly correlated with the total scores of the new tests,which means the performance of students in this set of tests can well predict the scientific literacy level of students around 15 years old.In scientific ability,the new evaluation scheme has a good external correlation with PISA,which verifies that the evaluation questions designed under the background of digital experiment can well examine students’ scientific ability.This scientific literacy evaluation is a meaningful attempt to evaluate students’ scientific literacy based on digital experiment as the main framework,and it provides a reference of ideas and process for promoting the application of digital experiments in practical science teaching and standardizing the evaluation of local students’ scientific literacy.