Font Size: a A A

A Study On The Validity Of Cloze Subtests In Tem4 (2005-2010)

Posted on:2011-07-10Degree:MasterType:Thesis
Country:ChinaCandidate:M M YaoFull Text:PDF
GTID:2195330332973826Subject:Foreign Linguistics and Applied Linguistics
Abstract/Summary:PDF Full Text Request
Cloze procedure, a gap-filling reading test, is a widely-adopted but controversial testing technique in all kinds of language tests today. Moreover, it has been employed in Test for English Majors Band Four (TEM4). But whether it is worthwhile to appear in TEM4 remains unknown now. Intrigued by the question, the researcher decides to carry out a validity study of TEM4 cloze after the reform, to be specific, from 2005 to 2010 based on the following three questions:(1)What are the specific characteristics of TEM4 cloze in the years 2005-2010(2) What is the validity of TEM4 cloze in the years 2005-2010(3) Can TEM4 cloze measure the testees' integrative language competence If not, what suggestions could be made for improvementFirstly, the researcher makes a detailed analysis of the characteristics of TEM4 cloze from 2005 to 2010 under TMF brought forward by Bachman from five aspects: testing environment, test rubric, characteristics of input, expected response and relationship between input and response.Secondly, face validity of TEM4 cloze is studied through questionnaire. It is altogether 100 sophomore English-majors who took TEM4 test in 2010 and 30 teachers who are experienced in teaching TEM4 in School of Foreign Languages, Nanchang University that finished the questionnaires. It can be concluded that 90% teachers and 88% students are satisfied with the appearance of TEM4 cloze and convinced that TEM4 cloze has high face validity. Moreover, almost 67.5% teachers and 85.5% students think TEM4 cloze is in accordance with teaching and testing syllabus. 66.7% teachers and 60% students believe TEM4 cloze to be the most difficult item in TEM4. Most teachers and students think TEM4 cloze tests students' vocabulary skills mainly. Moreover 83.3% teachers and 90% students welcome the improvement of TEM4 cloze. 67.5% teachers and 85.5% students are in favor of the improvement of TEM4 cloze in its form, topics and genre. 85% teachers and 98% students embrace the proposal of introducing C-test into TEM4 cloze. Fortunately, the thoughts which win the most votes of teachers and students fit in with the major findings and suggestions in the paper.Thirdly, content validity of TEM4 cloze from 2005 to 2010 is examined by content relevance and content coverage through the comparisons of TEM4 papers with Teaching Syllabus for English Majors(2000)(TSEM) and Testing Syllabus for English Majors (Band 4)(2004)(TSTEM). The result reflects that TEM4 cloze during six years are of relatively high content validity. However, the researcher also points out they are limited in topics, genre and the major testings of vocabulary, ideational function and sociolinguistic knowledge. Thus they fail to assess students' comprehensive language competence in all-around manner.Fourthly, the analysis of construct validity concludes TEM4 cloze from 2005 to 2010 measure both lower order ability and higher order ability, while emphasis has been put on lower order ability. Moreover, CVI which is calculated by the formula CVI=CTTP/TTTP reveals the consistent construct validity during the six years. In addition, Testing point validity proves that TEM4 cloze during the six years emphasize on the testing of vocabulary but the testing of words are largely fallen into sentence level.Lastly, based on the above analysis, the researcher puts forward the suggestions for the improvement of TEM4 cloze in the future such as the diversification of topics and genres, balance the testing of grammar and vocabulary, inclusion of the four...
Keywords/Search Tags:TEM4 cloze, face validity, content validity, construct validity, testing point validity, language competence
PDF Full Text Request
Related items