Earticle

초록

영어

“Does Raters’ Rating Experience Influence English-speaking Test Ratings?” Studies in English Language & Literature. 38.3 (2012): 243-263. In second language performance tests, rater effect has been a major concern in that it is a potential source of measurement error. The purpose of the study is to examine if raters' rating experience affects their English-speaking ratings. Two experienced and two less experienced native English-speaking raters scored 116 Korean college test-takers' English-speaking test responses. The data were analyzed with the GENOVA program and independent samples t-tests. The results revealed that both experienced and less experienced raters yielded almost identical dependability indices, showing that they scored with consistency the English-speaking samples within their group. The findings of this study also indicate that there is no significant rater effect on combined scores between experienced and less experienced raters. However, there is a significant rater experience effect on some analytic rating components such as pronunciation. Based on the findings, theoretical and practical implications are discussed. (Mokwon University)

목차

Abstract
 I. Introduction
 II. Literature Review
  2.1 Rater Characteristics
  2.2 Generalizability Theory in L2 Performance Assessments
 III. Methods
  3.1 Participants
  3.2 Test Instrument
  3.3 Scoring Criteria
  3.4 Data Analtsis
 IV. Result and Discussions
  4.1 Univariate Analysis Results
  4.2 Results of Independent Samples T-test for Experienced and Less Experienced Raters
 V. Conclusions
 Works Cited

키워드

저자

• Kyung-Ah Yu [ Mokwon University ]

참고문헌

발행기관

간행물

표지보기 관심저널 등록

• 간행물명

  영어영문학연구 [Studies on English Language & Literature]

• 간기

  계간

• pISSN

  1226-8682

• 수록기간

  1972~2020

• 십진분류

  KDC 840 DDC 820