Earticle

Investigating variability in rater groups on L2 writing in English

  • 간행물
    한국언어과학회 학술대회 바로가기
  • 권호(발행년)
    2011 한국언어과학회 여름학술대회 (2011.08) 바로가기
  • 페이지
    pp.113-120
  • 저자
    Yousun Shin
  • 언어
    영어(ENG)
  • URL
    https://www.earticle.net/Article/A398357

원문정보

초록

영어
The purpose of the study is to investigate how the judgment of raters is biased toward certain rating criteria or task types in assessing Korean university students’ L2 writing. In addition, the study aims to examine whether or not non-native rater group and native rater group share the same judgment of students’ written products. Six raters scored 258 compositions written by Korean university students on two topics. The written products were rated using an analytic scoring scale with content, organization, language in use, grammar, and mechanics. For the first part, the FACETS analysis revealed that all six raters showed self-consistent scoring patterns across the rating categories in the two tasks. However, each rater was biased towards certain type of tasks and rating categories. For the second part of the study, the results of ANOVA and MANOVA tests revealed that there were significant mean differences between the two groups across the rating categories in both tasks except content in Task 2. It is also shown that the non-native rater group is harsher in their rating than the native rater group regardless of the rating category.

목차

ABSTRACT
I. INTRODUCTION
II. RESEARCH DESIGN
1. Participants
2. Writing Tasks & Scoring Criteria
3. Research Questions
III. RESULTS
1. FACETS Analysis for Individual Raters’Rating Behaviors
2. Results of ANOVA and MANOVA Tests for Rater Groups
IV. DISCUSSIONS
V. CONCLUSION
REFERENCES

저자

  • Yousun Shin [ Pukyong National University ]

참고문헌

자료제공 : 네이버학술정보

    간행물 정보

    • 간행물
      한국언어과학회 학술대회
    • 간기
      반년간
    • 수록기간
      2001~2026
    • 십진분류
      KDC 705 DDC 405