A Narrative And Action Research On The Development Of Situational Questions-How Can Jars And Mirrors Appear On The Paper-and-Pencil Tests

While evaluating the education quality,paper-and-pencil test might be one of the most popular methods.In order to develop a scientific evaluation tool,which could effectively evaluate both the teachers' teaching quality and the students'academic level,scholars around the domestic and foreign had done a lot of practice research.Among them,the development of the situated questions as well as the open questions was one of the most important international test research directions.For the author,to have learned on the "Xinghua" platform during the graduate study phase should be a pleasure.Participated as a developer of junior high school science questions in the project hosted by the National Innovation Center for Assessment of Basic Education Quality--which was aimed at trying to exam and improve a district's education quality--had brought the author a deep understanding of how to develop and evaluate the open questions.Among these words,there was a hope that through the deep descriptions and reflections,it could cause a resonance for those people who were doing the same research and attract their eyes.This paper used the narrative and action research method to make a deep description of the whole process of the author's own experience on the test paper development,through a first-person narrative way.Including the action research of material collection and development,materials turning into questions,the students'feedback after the 30-person-small-scale-test,formulation of scoring standard,the test paper modification and grinding which based on the students' feedback,the screening and revision to the test paper after the 300-person-test,the students' performance in the large-scale-formal-test,the statistics and analysis towards the students'performance,empirical advice and guidance,and each link of the new round of the development of test paper.At the same time,this paper had choose a multiple-choice question and another open-question--both were based on the quality index of couples of tests-tried to make a detailed interpretation to the corresponding students' answers,and to analysis the students' possible thoughts and the reasons,wished to put forward some ideas that the author thought would be worth sharing and valuable for education evaluating.This paper has two clues,the main line is the time,selecting a various stages in the development of examine questions for more than a year,through the method of narration,showing the whole process of the question-developing work,from material collecting to question building,and finally selected in the large-scale test,after a lot of revision and grind.This was a narrative about self-growth.The second clue was hidden in the main line,starting from the link of "materials transformed to questions".At the same time,using a choice question about Pre-concept and an open question based on day-life phenomenon as carriers that are developed by the author,this part also hides the links to action research of questions grinding could improve the test quality in "spiral way".To reflect on this process,it was actually an action research on the development of open questions.The author participated in the whole project with the dual identities of the experiencer and the researcher,and then put forward my own thoughts and summaries.This paper combed the author's practice experience and thinking through three angles:the development of the open questions,the self-improvement,the lack of the research and reflection.First,according to the priority of each link through the process of the test paper development,4 viewpoints of the author were respectively proposed:materials,experience of inquiry,questions formed,and the diagnosis of the students by the open questions.For the details:1,materials form the daily-life would be more likely to promote our inquiry;2,a self-experience would help one to know the students' thoughts better,and to improve oneself as well;3,questioning techniques could be started from the multi angles and not only to "explain";4,open questions would be more helpful at diagnosing the students' learning difficulties and misunderstandings.Secondly,the self-growth through the "academic evaluation"project could be summarized as:1,join in the project would help the graduate to integration into the team faster;2,join in the project would help the graduate to acquire new knowledge and broaden their horizons as well.Finally,the reflection of the lack of this study were proposed through 3 angles:1,the limitation of the researcher;2,the amount of the selected sample questions were small;3,the study was lack of a preset link.It had showed the significance of the study with 3 aspects:introspection,common sense,and empirical summarizes.The summarize of the growing-up experience during the development of the examine questions is my precious wealth,in the process of continuous thinking and reflection makes me gradually found that work is not only "work",it is a process of discover the problems and then study them.In this experience I understand the the value of open questions and the significance of scientific inquiry.To evaluate students academic quality,we need to have a scientific evaluation scale,and to have a scientific evaluation scale,we must be engaged in the work of scientific research and scientific evaluation.In this way the author's experience have been sublimated,not only for the author's own great improvement,but also hopes to be able to provide a reference for those peers doing relevant researches.