다변량 일반화가능도 이론에 의한 말하기 시험의 타당도와 신뢰도에 관한 연구
An investigation into the dependability of ratings in a German speaking test using the multivariate generalizability theory
Even though performance-based language tests are often multivariate by design, previous validation studies have analyzed the dependability of ratings of such tests within univariate analytic frameworks. In an attempt to address this limitation, the present study investigated the dependability of judgements made based on ratings of a German speaking test using a multivariate generalizabilitiy theory (MGT) analysis. Data obtained from 88 students were analyzed in G- and D-studies of a two-facet crossed design. A D-study with two raters and two tasks supported the high dependability of the ratings and the placement decisions made at the pre-determined cut scores. An optimization analysis of the measurement procedure suggested that the desired level of dependability of ratings has already been achieved by the use of two raters and two tasks. The MGT analysis also generated other useful information about the convergent/ discriminant validity of the five subscales. Specifically, the universe score variance-covariance matrix obtained from the D-study showed that the underlying subscales were interrelated but distinct. Furthermore, the analysis of effective weights of the scales revealed that the Grammar subscale played the dominant role in the composite universe score variance.
목차
Abstract Ⅰ. 서론 Ⅱ. 이론적 배경 Ⅲ. 연구방법 Ⅳ. 연구결과 Ⅴ. 결론 및 제언 참고문헌
한국외국어교육학회 [The Korea Association of Foreign Languages Education]
설립연도
1995
분야
인문학>언어학
소개
본 학회는 외국어 교육 분야 상호간의 연구 성과 교류를 통하여, 외국어 교육의 이론과 실제를 발전시키고, 회원 상호간의 친목을 도모함으로써 외국어 교육 분야간의 학문적 교류를 활성화하는 것을 그 설립 목적으로 한다. 그리고 더 나아가서는 국제 협력 차원에서 다양한 언어 및 문화의 이해를 증진시키는 동시에 언어 정책과 관련하여 국제 관계 개선을 위한 가교 역할을 담당하고자 한다.