Earticle

현재 위치 Home

Research Article

AI-Driven Automated Writing Evaluation Feedback and Its Role in Developing EFL Writing Assessment Literacy : A Mixed-Methods Study

첫 페이지 보기
  • 발행기관
    아시아영어교육학회 바로가기
  • 간행물
    The Journal of AsiaTEFL SCOPUS KCI 등재 바로가기
  • 통권
    Vol.23 No.1 (2026.03)바로가기
  • 페이지
    pp.81-98
  • 저자
    Vicky Wei-Chi Pan
  • 언어
    영어(ENG)
  • URL
    https://www.earticle.net/Article/A482415

※ 기관로그인 시 무료 이용이 가능합니다.

5,200원

원문정보

초록

영어
This study is to investigate the effects of AI-driven feedback generated by My Access on EFL college students’ academic writing performance and student writing assessment literacy (SWAL). Adopting a mixed-methods research design with a quasi-experimental quantitative strand and a complementary qualitative strand, this study addressed four research questions concerning between-group differences in writing performance, within-group writing improvement, between-group differences in SWAL, and students’ perceptions of AI-driven feedback. Participants were fifty-three first-year vocational students assigned to either an experimental group (AI-driven feedback) or a control group (teacher feedback). They also completed different writing tasks and revised drafts across feedback cycles. Quantitative analyses examined pre- and post-test writing performance across six traits and SWAL across four dimensions. Results indicated there was no significant difference between the groups after testing, whereas the experimental group showed significant in-group improvement. MANCOVA revealed a statistically significant group effect in favor of the experimental group for SWAL, where stronger behavioral engagement was found to be more pronounced, and marginal gains were observed regarding assessment literacy. Qualitative data further indicated greater self-awareness, revision, and metacognitive engagement, but with caution regarding the utility of feedback. Overall, the findings indicate AI-driven feedback improves engagement and assessment literacy in EFL writing.
중국어
本研究探討人工智慧寫作評分系統 My Access 所提供之 AI 回饋對大學生英文寫作表現與寫作評量素養(SWAL)的影響。本研究採混合方法研究(MMR)之準實驗設計,並聚焦於四項研究問題:(1)AI 與教師回饋在寫作表現上的組間差異、(2)兩組學生在組內寫作進步情形、(3)兩種回饋在 SWAL 上的組間差異、(4)學生對 AI 回饋在寫作發展與評量素養之影響的感受。本研究招募 53 位具高職背景的大一學生,分為 AI 回饋實驗組與教師回饋控制組。學生完成三種類型的寫作並依回饋修訂。量化前後測評量六項寫作構面與 SWAL 四構面。研究結果顯示兩組在整體寫作表現上無顯著差異,但實驗組呈現顯著組內進步。MANCOVA 指出 SWAL 存在顯著組別效果,實驗組在行為構面優於控制組,知識構面則呈邊緣顯著。質性反思顯示學生感受到自我覺察、寫作知識與後設認知投入的提升,但對 AI 準確性仍持有不同態度。整體而言,AI 回饋有助提升學生之學習投入與寫作評量素養。

목차

Abstract
중문요약
Introduction
Literature Review
Challenges in EFL Academic Writing and Feedback
Teacher Feedback and AI-Driven AWE Feedback
The Role of Student Writing Assessment Literacy (SWAL)
Method
Research Design
Purpose and Function of Mixed Methods
Procedural Steps
Quantitative Strand
Qualitative Strand
Integration
Results
Effects of AI-Generated Feedback on Writing Performance
Within-Group Effects of AI-Generated and Teacher Feedback on Writing Performance
Effects of AI-Generated Feedback on Writing Assessment Literacy (SWAL)
Students’ Perceptions of AI-Generated Feedback and Their Relationship to SWAL Development
Discussion
Conclusion
The Author
References

키워드

AI-driven feedback automated writing evaluation student writing assessment literacy EFL writing assessment learner engagement mixed-methods research (MMR)

저자

  • Vicky Wei-Chi Pan [ Wenzao Ursuline University of Languages ]

참고문헌

자료제공 : 네이버학술정보

간행물 정보

발행기관

  • 발행기관명
    아시아영어교육학회 [Asia TEFL]
  • 설립연도
    2004
  • 분야
    사회과학>교육학
  • 소개
    The goals of Asia TEFL are to promote scholarship, disseminate information, and facilitate cross-cultural understanding among persons concerned with the teaching and learning of English in Asia. In order to accomplish this, Asia TEFL will pursue the following goals: 1. To link ELT professionals in joint research on issues and concerns regarding English teaching and learning in the Asian context. 2. To publish an academic journal, The Asia TEFL Journal, as an internationally recognized journal in the field of English language teaching. 3. To host conferences and seminars addressing important issues concerning ELT in Asia. 4. To develop proficiency guidelines and assessment methods designed for the needs of the Asian context. 5. To develop programs for Asian learners and teachers of English to build their English language proficiency and cultural understanding and provide them with the skills required to be efficient English teaching professionals.

간행물

  • 간행물명
    The Journal of AsiaTEFL
  • 간기
    계간
  • pISSN
    1738-3102
  • eISSN
    2466-1511
  • 수록기간
    2004~2026
  • 등재여부
    SCOPUS,KCI 등재
  • 십진분류
    KDC 740 DDC 420

이 권호 내 다른 논문 / The Journal of AsiaTEFL Vol.23 No.1

    피인용수 : 0(자료제공 : 네이버학술정보)

    함께 이용한 논문 이 논문을 다운로드한 분들이 이용한 다른 논문입니다.

      페이지 저장