Most of colleges have made efforts to adapt National Competency Standards (NCS) into their education system by developing and offering courses about NCS vocational competencies such as communication skills. However, instructors are suffering from teaching NCS vocational competencies. In specific, they are having difficulty in assessing students’ achievement due to a lack of objectivity and consistency of existing assessment instruments of NCS vocational competency. In a preceding study, the researchers developed a performance assessment instrument to assess NCS communication skills. The assessment instrument for document comprehension skills and document writing skills were developed for descriptive assessments and essay assessments instrument and the assessment instrument for listening comprehension skills and linguistic expression skills were developed in the form of tester checklists and testee checklists. The purpose of this study is to test the reliability and usability of the developed NCS communication skills performance assessment instrument. In order to test the reliability of NCS communication skill assessment instrument, Cronbach α and the reliability of evaluators were examined. The usability of the performance assessment instrument was tested by three instructors who were teaching communication courses. As the result of analyzing the Cronbach α, coefficient of intraclass correlation, and Cohen’s Kappa value to test the reliability, all assessment instruments showed high reliability. The result of the usability test of assessment instrument by instructors also showed high usability. In particular, we were able to identify improvement points of developed tool through interview with instructors.
목차
Abstract 1. Introduction 2. NCS Communication Skill Performance Assessment Instrument 3. Methodology 3.1. Reliability Verification 3.2. Verification of Usability 4. Results 4.1. Results of NCS Communication Performance Assessment Tool’s Reliability Test 4.3. Analysis Results of Evaluator Reliability Analysis 4.2. Results of Usability of NCS Communication Performance Assessment Instrument 5. Conclusion References
키워드
National Competency StandardsPerformance AssessmentNCS Communication SkillsReliabilityUsability
저자
Jooyoung Kim [ Educational Technology, Collage of Education, Andong National University, Andong, Korea ]
Jaewoo Do [ Dept. of Educational Psychology & Counseling, University of Tennessee 535 Jane & David Bailey Education Complex,1122 Volunteer Boulevard, Knoxville, Tennessee 379963452, United State ]
보안공학연구지원센터(IJSEIA) [Science & Engineering Research Support Center, Republic of Korea(IJSEIA)]
설립연도
2006
분야
공학>컴퓨터학
소개
1. 보안공학에 대한 각종 조사 및 연구
2. 보안공학에 대한 응용기술 연구 및 발표
3. 보안공학에 관한 각종 학술 발표회 및 전시회 개최
4. 보안공학 기술의 상호 협조 및 정보교환
5. 보안공학에 관한 표준화 사업 및 규격의 제정
6. 보안공학에 관한 산학연 협동의 증진
7. 국제적 학술 교류 및 기술 협력
8. 보안공학에 관한 논문지 발간
9. 기타 본 회 목적 달성에 필요한 사업
간행물
간행물명
International Journal of Software Engineering and Its Applications
간기
월간
pISSN
1738-9984
수록기간
2008~2016
등재여부
SCOPUS
십진분류
KDC 505DDC 605
이 권호 내 다른 논문 / International Journal of Software Engineering and Its Applications Vol.10 No.10