| The purpose of the project presented in this dissertation was to investigate the validity of the use of the STEP EIKEN test as an English language proficiency screening test to admit international students into a U.S. community college in Hawaii. A utilization-focused evaluation approach was adopted, which served to focus the validation process on the needs of primary intended users for their primary intended uses.;Quantitative and qualitative research methods, using both objective measures (e.g., English test scores, institutional records) and perception data (e.g., questionnaires and interviews), from a variety of sources (e.g., faculty, students, executive administrators) were utilized to investigate: (a) the quality of the EIKEN test and its relationship with the TOEFL Paper-and-pencil Based Test (PBT); (b) the linguistic ability differences between the students admitted based on the EIKEN and those admitted on the TOEFL; and (c) the academic performance and experience differences between the students admitted based on the EIKEN and those admitted on the TOEFL. Mixed methods interactive data analysis strategies were used to consolidate convergent and divergent findings in data interpretation.;The findings, evaluated through both parallel tracks analysis by myself, the evaluator, and results synthesis by the stakeholders, largely supported the current admissions policy regarding the use of EIKEN grades. Given limitations in these data and the fact that students are admitted increasingly based on the TOEFL iBT, it was recommended that the stakeholders continue to monitor the students' performance.;Formative evaluation findings identified areas of improvement in the way the college serves international students, including those students admitted based on the EIKEN test. This project made unique theoretical contributions in the areas of test linking and consequential validity. It also provided practical implications for testing professionals to conduct evaluations related to the consequential validity of test use decisions. |
