Earticle

고품질 소프트웨어의 요구 증가로 국제표준, 산업 기능안전(IEC 61508), 자동차(ISO 26262), 무기체계 내장형 소프트웨어 지침 등 품질 인증 요구가 많다. 스타트 업, 벤처, 중소 업체들은 비용 및 인력 측면에서 체계적인 품질 획득이 어려움이 있다. 그들 업체에게 자동 테스트 케이스 생성은 비용, 시간, 인력 문제에도 소프트웨어 품질을 향상할 수 있는 해법으로 제시 될 수 있다. 이를 위해, 시스템 및 소프트웨어 설계 검증이 가능한 "의사 결정표" 기반 테스트 케이스 자동화를 제안한다. 이는 OMG의 표준 기법인 메타모델과 모델 변환 기법을 사용해 각각 의사 결정표(Model)와 테스트 케이스(Text)의 메타모델 설계 및 모델변환을 정의한다. 즉 의사 결정표 입력으로 테스트 케이스 발생 자동화이다. 이를 통해 MC/DC 커버리지등도 쉽게 적용 가능하다.

As the increasing demand for high-quality software, there is huge requiring for quality certification of international standards, industrial functional safety (IEC 61508), automotive (ISO 26262), embedded software guidelines for weapon systems, etc., in the industry. Software companies are very difficult to systematically acquire the quality certification in terms of cost and manpower of Startup, venture small-sized companies. For their companies one test case automatic generation is considered as a core technique to evaluate or improve software quality. This paper proposes a test case automatic generation method based on the design decision table for system and software design verification. We apply the proposed method with OMG's standard techniques of metamodel and model transformation for automatically generating test cases. To do this, we design the metamodels of design decision table (Model) and test case document (Text) and define model transformation to automatically generate test cases, which will expect to easily work MC/DC coverage.

Safety Critical 시스템은 고장의 발생으로 인하여 심각한 인적 물적 손실을 유발할 수 있는 시스템을 말한다. 따라서 이러한 시스템의 안전성(Safety)을 보장하기 위하여 시스템의 모든 동작에서 비정상적인 행위를 보일 때, 이에 대한 적절한 대처가 가능하도록 강건한 소프트웨어 개발이 요구된다. 그러나 강건한(Robust) 소프트웨어의 개발을 위해서는 많은 비용이 요구되기도 하지만, 개발자가 모든 비정상적인 행위를 예측하여 소프트웨어를 개발하기는 매우 힘들다. 본 논문에서는 안전성이 중요한 소프트웨어의 비정상적인 행위를 테스트하기 위한 테스트 케이스를 개발하기 위한 기법을 제안한다. 즉, 정상적인 동작을 수행하는 경우에 대해서는 배제하고, 단지 비정상적인 경우에 해당되는 테스트 케이스만을 생성한다. 제안한 방법에 의거하여 생성된 테스트 케이스는 Safety Critical System의 운영 과정에서 발생할 수 있는 비정상적인 행위를 사전에 찾아낼 수 있을 것이다.

Safety critical system is a system where human safety and property damage are dependent upon the correct operation of the system. Therefore, in order to develop robust and safe software, it is required to prepare the appropriate countermeasure to cope with abnormal behaviors of the system. However the development of robust software requires high cost, and also it is difficult to predict all possible cases of abnormal behaviors in the development. This paper suggests a technique to generate test case for the purpose of safety test when system behaves abnormally. Specially, our paper focuses on just abnormal cases with exclusion of normal cases. The test case generated by our technique can find the abnormal behaviors possible in field operation of safety critical system during the software development.

본 논문은 게임 소프트웨어 프로세스 중에서 분석 및 설계 단계의 산출물 중 시퀀스 다이어그램과 OCL 컨트랙트 명세를 기반으로 하여 테스트 모델을 생성하고 생성된 모델을 기반으로 하여 테스트 케이스를 생성하는 기법을 제안 한다. 생성된 테스트 케이스는 테스트 수행뿐만 아니라 테스트 자동화를 위하여 생성하는 테스트 드라이버 작성시 활 용 가능하다.

Interoperability test is to check how those components collaborate each other in real environment not in the development environment. Therefore, the research on the inter-operability is crucially important. In this paper, a new technique is proposed for generating a test case which is necessary for checking the inter-operability of the components in the component-based software.

현대 소프트웨어는 종종 소스코드에 존재하는 오류나 보안약점을 이용한 공격으로 인해 보안사고 에 노출된다. 최근 정적분석 도구가 갖게 된 기술의 진보와 상업적인 성공이 개발자들로 하여금 정적 분석 도구를 사용하여 오류나 보안취약점을 배포 전에 검출할 수 있게 되었다. 정적분석의 여러 가지 이점에도, 정적분석 결과에 존재하는 오검출과 미검출로 인해 개발자들이 정적분석도구의 사용을 꺼 리는 경향이 있다. 본 논문에서는, 뮤테이션 테스팅 기법에 기반하여 정적분석도구 테스트코드를 자 동으로 생성하는 효율적인 방법을 제안한다. 실제로 상용 출시된 정적분석 도구의 일부 미탐을 이 방법으로 발견하였다.

Modern Software is often exposed to security accidents primarily due to malicious hackings taking advantage of defects and vulnerabilities residing in source code. Recent technological advance and commercial success of static-analysis tools have made it possible for software developers to use the tools and detect safety defects and security vulnerabilities before release. Despite the advantages of static code analysis, the developers tend to avoid using it because of the immoderate false negatives and positives. In this paper, we propose an effective method of automatically generating test codes for static-analysis tools based on mutation testing techniques. In fact, several false-negatives of commercially released a static analysis tool were found by this method.

Studies on the testing techniques required during process of black box testing in embedded system have been increasing tremendously. This paper suggests test model and test case generation method for model based testing of embedded system. Considering the complicated internal architecture and real-time characteristics of embedded system, test cases are generated by using the state based behavior modeling method. The proposed state transition model based test case generation method suggests systematic procedures ranged from the use case specification to the test case generation. Entire procedure of test case generation in MP3 player case which uses the suggested method is presented in this paper. With the created test cases, the interaction among the components of embedded system can be easily figured out, thereby helping easy error detection. Moreover, the test cases applied with characteristics and constraints of embedded system could be achieved by modeling system behavior using SysML.

We propose a local search based approach to generate automatically test cases for programs having floating point statements. The proposed approach, called MLFP (for Multi-precision arithmetic and Local search for Floating Point constraints), adopts a local search approach to solve constraints on floating point numbers. Compared to the classical integer domain, floating point numbers F have two particular properties: they have a huge cardinality (e.g., 252 numbers in the interval [0.5, 1.0] with the "double" format), huge values (e.g. 10300), and also tiny values (e.g. 10-300). This huge combinatorial nature of the search space motivates using a local search approach. In order to find test cases containing huge or tiny numbers, such as overflow or underflow exception errors, MLFP uses the multiple precision MPFR library. Our local search approach proceeds in two steps. The first step exploits a line search algorithm to converge quickly to an approximate solution on real numbers. The second step adopts a dedicated local search algorithm on floating point numbers in order to find an exact solution, by using specific neighborhood and evaluation functions. We have implemented the MLFP approach, and we have shown its usefulness on various non trivial programs having floating point statements.

Formal methods and testing are two important approaches that assist in the development of cyber physical systems. Formal specification can be used to assist testing and Formal methods and testing are seen as complementary. In this paper, we address the problem of generating test cases for cyber physical systems from formal specifications using differential dynamic logic(DL), a logic for specifying and verifying hybrid systems.

A challenging part of Software Testing entails the generation of test cases, whose costs can be reduced by means of the use of techniques for automating this task. On the other hand, the nature of Software Engineering problems is ideal for the application of metaheuristic techniques. In this paper we present an approach based on the metaheuristic technique Scatter Search for the automatic test case generation of BPEL business processes using a transition-pair coverage criterion. The test case generator is called TCSS-LS-for-BPEL and it combines a diversity property with a local search. The diversity property is used to extend the search of test cases in order to reach different transitions of the business process. The local search is used to intensify the search when the diversification has problems to find test cases that cover transitions that have not been covered yet. We present the results obtained by our test case generator using two sample compositions and carry out a comparison with a random generator. The results indicate that TCSS-LS-for-BPEL can be used in the generation of test cases for BPEL business processes.

Combinatorial testing has been proved to be an efficient strategy in software testing. The research on automatic test case generation for system level based on components with constraints is a challenging but significant problem by using combinatorial testing. This paper focuses on the test case generation for system level based on components with sequential constraints. There are three main contributions: 1) the new test case generation strategy for system level is proposed based on IPOG (In-Parameter-Order-General) algorithm; 2) a filling strategy for don’t care positions is given to enhance the higher strength coverage for system level, which can improve the quality of the generated test suite; 3) a randomized post-optimization algorithm is applied to reduce the size of the test suite for system level. Experimental results show that the proposed filling strategy can improve the quality of the covering array, the post-optimization algorithm has a good optimization effect on reducing the size of the array, and trades off better between the size of the covering array and computational time than simulated annealing (SA).

To generate test cases for the unit testing of business process written in BPEL, developers have to prepare input data for the BPEL process under test (PUT) and verification conditions for output data from the PUT. It could be a tedious task due to the complexity of the PUT which describes the web flow of a distributed collaboration of individual service providers executing concurrently. This paper shows how Stream X-machine (SXM) based testing techniques could be applied to automatically generate test cases for BPEL process. The SXM describes a system as a finite set of states, an internal memory and a number of transitions between the states. One of the strengths of using a SXM to specify a system is that, under certain well defined conditions, it is possible to produce a test suite that is guaranteed to determine the correctness of the implementation under test.

A challenging part of software testing entails the generation of test cases. A good test case should have the quality to cover more features of test objective. The techniques for automatic generation of test cases try to efficiently find a small set of cases that allow an adequacy criterion to be fulfilled, thus reducing the cost of software testing and resulting in more efficient testing of software products. In this paper we introduce an all-around classification framework for automatic test case generation approaches in terms of test type and Algorithm, and represent some test case evaluation approaches. Finally we illustrate a comparison between different existing techniques.

To ensure software quality software testing is done .Test data generation is one of the more expensive parts of software testing. So, for reducing software cost and development time automation of test data generation is required. The object-oriented paradigm can be challenging for generating test data, due to some aspects of its features like abstract class, encapsulation, inheritance and visibility. To reach high code coverage of object oriented code search based test data generation technique is used. Proposed approach show that how efficiency and effectiveness of search based test data generation using static analysis. System takes input as different java class files then instances are generated for that classes then generate sequence of method call for whole code coverage then using genetic algorithm which is very useful and work efficiently when there is large search space it use to reach test target and finally generate test cases in Junit format which are helpful for all developers to perform unit testing.

The advancement of generative AI technologies has significantly impacted various domains in software engineering, particularly in automating test case generation. As software systems become increasingly complex, manual test case creation faces limitations in terms of efficiency and coverage. This study analyzes the capabilities and limitations of major generative AI models—ChatGPT, Copilot, and Gemini—in generating software test cases. We focus on evaluating their performance in boundary value analysis, exception handling, and property-based testing. Using the ArrayUtils.indexOf() function from the Apache Commons Lang library as the test subject, we conducted experiments to compare the quality and effectiveness of the test cases generated by each model. Our findings indicate that while generative AI can efficiently produce a substantial number of high-quality test cases, there are instances of incorrect test cases and test codes. To address these issues, we propose guidelines for developers to enhance the reliability and consistency of test case generation using generative AI. Future research will explore the application of these models to more complex software systems and further methods to improve their test generation capabilities.

It is still not sufficient for the famous embedded software test methods such as Finite State Machine, Software Cost Reduction and model coverage based test case generation, to pinpoint where bugs hang around and to figure out what makes the bugs. A new approach to ameliorate the drawbacks is proposed in this paper. In the approach, we define a generic model for embedded software. And we also define failure mechanism for embedded software, and a way to generate test cases based on it.

QoS monitoring is a kind of real-time systems which allows each level of the system to track the ongoing QoS levels achieved by the lower network layers. For these systems, real-time communications between corresponding transport protocol objects is essential for their correct behavior. When two or more entities are employed to perform a certain task as in the case of communication protocols, the capability to do so is called interoperability and considered as the essential aspect of correctness of communication systems. This paper describes a formal approach on modeling and interoperability test case generation of a real-time QoS monitoring protocol. For this, we specify the behavior of flow monitoring of transport layer QoS protocol, i.e., METS protocol, which is proposed to address QoS from an end-to-end's point of view, based on QoS architecture model which includes ATM net work in lower layers. We use a real-time Input/Output finite State Machine to model the behavior of real-time flow monitoring over time. From the modeled real-time I/OFSM, we generate interoperability test cases to check the correctness of METS protocol's flow monitoring behaviors for two end systems. A new approach to efficient interoperability testing is described and the method of interoperability test cases generation is shown with the example of METS protocol's flow monitoring. The current TTCN is not appropriate for testing real-time and multimedia systems. Because test events in TTCN are for message-based system and not for stream-based systems, the real-time in TTCN can only be approximated. This paper also proposes the notation of real-time Abstract Test Suite by means of real-time extension of TTCN. This approach gives the advantages that only a few syntactical changes are necessary, and TTCN and real-time TTCN are compatible. This formal approach on interoperability testing can be applied to the real-time protocols related to IMT-2000, B-ISDN and real-time systems.

사전 제조된 컴포넌트들을 재사용하여 애플리케이션을 개발하는 컴포넌트 사용자의 관심사는 사용자의 요구사항에 따라 적절히 다른 컴포넌트들과 협동하는지 여부를 확인하는 것이다. 따라서 컴포넌트 기반 소프트웨어의 경우 개발 환경이 아닌 새로운 환경에서 소프트웨어를 구성하는 컴포넌트들이 잘 연동되는지를 테스트할 수 있는 상호운용성 테스트에 관련된 연구가 중요시되고 있다. 본 논문에서는 컴포넌트 기반 소프트웨어의 상호운용성 테스트를 위한 테스트 모델을 정의하고, 유스케이스 명세로부터 테스트 모델을 생성한 후 생성된 모델로부터 테스트 케이스를 생성하는 기법을 제안한다. 또한 테스트 모델로부터 테스트 시퀀스를 생성하는 프로시저를 구현한 도구를 소개한다.

The major concern of component users who develop applications using the existing components is to confirm whether a component is collaborating with the different components in accordance with the requirements. Therefore, interoperability testing whose role is to check whether components collaborate with each other within the new operating environment not within the component development content of each component is considered as an importance research topic. In this paper, we propose a test case generation technique for interoperability test of component based software. The proposed technique defines a test model for generating test cases. The proposed technique generates test models from the use case specification and thereafter from these models, test cases for Interoperability testing are derived. In addition, we describe a tool which Implements the procedures for generating test sequences from test models.

오늘날 GUI가 소프트웨어의 성공에 중요한 영향을 미침으로써 GUI에 대한 테스트가 요구된다. 반면에 소프트웨어의 GUI 테스트는 많은 노력과 시간이 소비된다. 이러한 자원의 소비를 줄이기 위해 GUI 테스트를 자동으로 수행하는 것이 필요하다. 본 논문에서는 GUI 자동 테스트를 수행하기 위해 극복해야 할 문제와 GUI 자동 테스트에 적용되는 기술에 대해 논하고, Record-Playback 기술을 이용하여 GUI 테스트 케이스 자동 생성 방법을 제시한다.