Earticle

디지털 전환(digital transformation)이 가속화되어감에 따라 국내를 비롯한 국제 경제, 사회 전반의 변화에 영향을 미치고 있으며 기술변화의 중심에는 SW가 있다. SW는 지적 노동의 결과물로서 인력의 전문성에 의해 좌우되기 때문에, SW 품질의 확보를 위해서는 인력의 능력에 대한 검증이 필요하며 자격 제도는 이를 위한 효과적인 수단이다. SW 테스트 전문가(CSTS) 자격은 ’08년도부터 시행된 SW 테스 트 지식, 기술 능력을 평가하는 국내 유일 자격으로서 본 연구에서는 SW 테스트 전문가(CSTS) 자격의 시험결과에 영향을 미치는 요인은 무엇인지 탐색하였다. 이를 위해, 2018~2019년도 자격시험 응시자 907명의 결과를 활용하였으며, SPSS 22.0 프로그램을 활용 t검정, ANOVA, 이분형 로지스틱 회귀분석 을 하였다. 분석결과 응시년도와 응시자 특성 중 연령, 학력, 경력에 따라 시험점수에 유의한 차이를 나 타냈으며, 자격시험에 응시하기 전 교육에 참여하는 것은 합격률을 높이는 데 유의한 효과가 있음을 확 인하였다. 분석 결과를 바탕으로 SW 테스트 전문가(CSTS) 자격이 인력의 능력을 충분히 담보할 수 있 는 전문기술 자격으로 거듭나기 위하여 문항 단위 분석을 통한 자격제도의 운영, 현장 중심 교육훈련의 자격시험 전․후 제공, (전문)대학 등 정규교육 과정에 SW 테스트 교육의 확대 및 지역 SW 산업인력 육성 강화 필요성을 제언하였다.

As digital transformation is accelerating, the software is at the center of technological change. the software is the result of intellectual labor, it is necessary to verify the capabilities of human resources to secure software quality, and the qualification system is an effective means for this. The certified software test specialist(CSTS) is the only qualification in South Korea that evaluates software test competency, which has been developed since 2008. In this study, we explored what factors affect the qualification exam results. To this end, the results of 907 applicants for the 2018-2019 qualification exams were utilized, and t-test, ANOVA, and binary logistic regression analysis were conducted using the SPSS program. The analysis showed significant differences in scores according to age, academic background, and experience among the applicants' characteristics, and confirmed that participating in education had a significant effect. Based on the results, to transform the CSTS into a specialized technical qualification exam that can sufficiently secure the capabilities of the human resource, the qualification system is operated through the analysis of each item, and the education needs to be served. Also, it is suggested that the necessity of fostering local software testing human resources and reinforcing the expertise of academic students.

본 연구는 SW 테스팅 능력을 검정하는 국가공인 CSTS 일반등급 민간자격의 검정문항을 분석하는 것이다. 이를 위해, 2020년부터 2021년까지 2년 동안 8회에 걸쳐 총 1,556명이 응시한 검정문항 중 4지선다형과 진 위형 총 480문항을 분석대상으로 하였다. 분석은 고전검사이론과 문항반응이론을 적용하여 난이도, 변별도와 추측도를 추정하였으며, 연도 간 비교와 문항에 부여된 난이도를 바탕으로 분류하여 분석한 주요결과는 다음과 같다. 첫째, 연도와 일부 검정회차 간 취득점수의 차이가 존재하여 검정난이도의 일관성이 부분적으로 유지되 지 못하고 있는 것으로 나타났다. 둘째, 문항난이도를 추정한 결과 CSTS 일반등급 자격은 전반적으로 쉬운 문 항으로 구성되어 있는 것으로 나타났다. 다만, 일부 문항은 문항에 부여된 난이도와 상반되는 난이도 지수가 추정되고 있어 개선이 필요함을 확인하였다. 셋째, 문항변별도를 추정한 결과 낮은 변별력을 보이는 문항들이 일부 존재함을 확인하였으며, 문항에 부여된 난이도가 낮은 경우 변별도가 낮은 문항의 비율이 적은 것으로 나 타났다. 넷째, 문항추측도를 추정한 결과 기준 이상의 추측도를 보이는 문항이 분류되었으며, 문항에 부여된 난 이도를 기준으로 하였을 때 두 검사이론 간 상반되는 차이를 나타냈다. 연구결과를 바탕으로 문항에 부여된 난 이도와 상반되는 문항난이도 지수가 추정된 문항과 낮은 문항변별도 지수를 나타낸 문항, 그리고 높은 추측도 지수를 나타낸 문항에 대하여 우선적인 난이도의 조정, 내용전문가 참여를 통한 문항 내용의 검토와 개선이 필 요하며, 자격제도 관리․운영 절차에 검사이론을 바탕으로 하는 문항과 검사에 대한 분석과 개선의 과정이 내재 화되어야 함을 제언하였다.

The purpose of this study is to analyze the test items of the nationally authorized CSTS private qualification that tests SW testing ability. A total of 480 items were analyzed among the test items that a total of 1,556 people took 8 times over two years from 2020. Item difficulty, discrimination, and guessing were estimated by applying classical test theory and item response theory, First result of the research, the consistency of difficulty was not maintained in the scores obtained between years and between sessions. Second, as a result of estimating the item difficulty, it was composed of easy items overall, but the year 2020 showed a higher difficulty. Also, some items had an item difficulty index contrary to the difficulty assigned to the item. Third, as a result of estimating the item discrimination, it was confirmed that there were some items with low item discrimination, and in the case of items with low difficulty, the proportion of items with low discrimination was the smallest. Fourth, as a result of estimating the item guessing, some high-guessing items were classified, and when examined based on the difficulty assigned to the item, the two test theories showed opposite differences. Based on the results, items with the opposite difficulty, low item discrimination, and high guessing items should be reviewed and improved through the participation of subject matter experts.

This paper describes safety-critical software qualification methods and its approach, which corresponds to well-structured qualification organization, methods and results, software quality assurance, and software configuration management. This paper also describes the verification test environment, test components and items, a traceability analysis, and system tests as a result of software qualification based on Software Requirement Specifications (SRS) for a safety-grade optical modem of a Core Protection Calculator (CPC) in a Korea Standard Nuclear Power Plant (KSNP), and Software Design Specifications (SDS) for a safety-grade optical modem of a CPC in a KSNP. We believe that we achieve the functionality, performance, reliability, and safety, which are the software qualification objective goals of safety-critical systems.

This paper describes the case of Independent Software Verification and Validation(V&V). As an example, verification and validation of the graphic recorder is introduced. Graphic recorder as a verification and validation paradigm describe the qualification approaching techniques and methods. Graphic recorder is a measurement data recording device with 5.5 inch TFT liquid crystal display instead of a paper. It mainly describes V&V criteria, testing approach, software verification methodology, techniques and procedures. However, hardware based equipment qualification (i.e. environment qualification, seismic qualification, and EMI/RFI qualification) has been excluded. The V&V methods for each phase of the software life cycle and V&V input-output tasks, with a focus on the processes are described. From the initial phase to the final phase of development, development and testing/verification were performed according to the software life cycle based on information engineering methodology. The suggested validation and verification paradigm is satisfied with SRP7/BTP-14 criteria, which is the digital software licensing standard for safety-critical system (for example, aerospace, railways, automobile and nuclear industry etc). The paper addresses the pass/fail criteria for each phase of the software life cycle referenced by hierarchical international standard framework.

National qualification system for SW engineering is intended to be mechanisms to assure the competence of SW professionals. Qualification system for SW engineering can be categorized as national qualification, nationally certified private qualification, and private qualifications. In this paper, we present a summary report of needs analysis for new national qualification systems, based on the survey from human resource department managers of IT companies in IT service, package SW and embedded SW industry. The survey results show that SW qualification system is appropriate for evaluation and career management, but does not provide up-to-date information concerning the technology assessment and change. Based on the result form needs analysis, we suggest the SW specialist and embedded SW specialist as new licenses in national qualification system. In addition, we also propose SW quality management engineer, systems management engineer, IT Protect management engineer, network management engineer and SW architect engineer, as new nationally certified private qualifications.