The Hsk (advanced) Writing Test Score Differences, The Background Differences In Two Types Of Raters

There has been little research into the effect of raters' background on assessments made in language tests, tests of Chinese as a second language in particular. The article explores the effect that the raters' linguistic background has on assessments of compositions in a HSK(advanced) test. Using p × r design of G-theory, 10 professional and 10 nonprofessional raters rated the same 20 compositions and gave three primary reasons of rating with the aid of the HSK composition rating standards as demanded.The analyses contain two parts: the analysis of the scores and the analysis of the reasons. The result shows that both types of raters are able to make acceptable distinctions between high level and low level compositions. But seeing that nonprofessional raters made much greater systematic errors in the rating, professional raters can better distinguish the true proficiency level of the composition writers than nonprofessional raters. In the regard of using rating standards, professional raters look more upon the form level of the compositions such as grammar, vocabulary etc. while nonprofessional raters look more upon content and coherence etc. that matter with the communicative effects of the compositions.