Content: On the basis of shortcomings of study on multisource ratings of Classic Testing Theory. The article use multivariate Generalizability Theory studying rater effects of multisource rating, across-dimision interrater agreement, the effect of rating purpose to quality of rating. The result shows that (1) rater effects take a great part in the total variance of performance assessment, (2) the quality of rating of peer ratings is better than that of supervisor rating of peer ratings in the systems of multisource ratings, (3) in supervisor rating, interrater agreement of developmental assessment is higher than that of administrative assessment. This article wants to give theoretical and technical guide for use of multisource ratings in enterprises by these preliminary exploration.
|