Earticle

Safety Critical 시스템은 고장의 발생으로 인하여 심각한 인적 물적 손실을 유발할 수 있는 시스템을 말한다. 따라서 이러한 시스템의 안전성(Safety)을 보장하기 위하여 시스템의 모든 동작에서 비정상적인 행위를 보일 때, 이에 대한 적절한 대처가 가능하도록 강건한 소프트웨어 개발이 요구된다. 그러나 강건한(Robust) 소프트웨어의 개발을 위해서는 많은 비용이 요구되기도 하지만, 개발자가 모든 비정상적인 행위를 예측하여 소프트웨어를 개발하기는 매우 힘들다. 본 논문에서는 안전성이 중요한 소프트웨어의 비정상적인 행위를 테스트하기 위한 테스트 케이스를 개발하기 위한 기법을 제안한다. 즉, 정상적인 동작을 수행하는 경우에 대해서는 배제하고, 단지 비정상적인 경우에 해당되는 테스트 케이스만을 생성한다. 제안한 방법에 의거하여 생성된 테스트 케이스는 Safety Critical System의 운영 과정에서 발생할 수 있는 비정상적인 행위를 사전에 찾아낼 수 있을 것이다.

Safety critical system is a system where human safety and property damage are dependent upon the correct operation of the system. Therefore, in order to develop robust and safe software, it is required to prepare the appropriate countermeasure to cope with abnormal behaviors of the system. However the development of robust software requires high cost, and also it is difficult to predict all possible cases of abnormal behaviors in the development. This paper suggests a technique to generate test case for the purpose of safety test when system behaves abnormally. Specially, our paper focuses on just abnormal cases with exclusion of normal cases. The test case generated by our technique can find the abnormal behaviors possible in field operation of safety critical system during the software development.

본 논문은 게임 소프트웨어 프로세스 중에서 분석 및 설계 단계의 산출물 중 시퀀스 다이어그램과 OCL 컨트랙트 명세를 기반으로 하여 테스트 모델을 생성하고 생성된 모델을 기반으로 하여 테스트 케이스를 생성하는 기법을 제안 한다. 생성된 테스트 케이스는 테스트 수행뿐만 아니라 테스트 자동화를 위하여 생성하는 테스트 드라이버 작성시 활 용 가능하다.

Interoperability test is to check how those components collaborate each other in real environment not in the development environment. Therefore, the research on the inter-operability is crucially important. In this paper, a new technique is proposed for generating a test case which is necessary for checking the inter-operability of the components in the component-based software.

A challenging part of software testing entails the generation of test cases. A good test case should have the quality to cover more features of test objective. The techniques for automatic generation of test cases try to efficiently find a small set of cases that allow an adequacy criterion to be fulfilled, thus reducing the cost of software testing and resulting in more efficient testing of software products. In this paper we introduce an all-around classification framework for automatic test case generation approaches in terms of test type and Algorithm, and represent some test case evaluation approaches. Finally we illustrate a comparison between different existing techniques.

Generation of test cases is challenging part of software testing phase. Test cases must have ability to cover more test objective features i.e., achieve more test coverage. The different techniques for automatic generation of test cases find small set of test cases reduce human efforts as well as cost of software testing and produce most efficient and effective testing of software product. This survey gives overview of different techniques of automatic test cases generation.

The Unified Modeling Language (UML) is a standard notation used to model user’s requirements for object oriented software systems. With the growing adoption of UML by software developers and researchers, studies have begun to investigate how it can be used to conduct testing. Several approaches of UML-based software testing have been proposed where test cases are derived from UML diagrams based on efficient algorithms. However, these approaches still suffer from three major limitations namely; inadequate test coverage criteria, insufficient diagrams coverages and incompatibility with various UML tools. Therefore, this paper proposes an improved approach for generating test cases from various UML diagrams based on full coverage criteria. To achieve this aim, a robust method for extracting artefacts from the underlying diagrams of the software under test (SUT) was developed, where the artefacts are represented in an intermediate form using a tree and test cases are generated by traversing the contents of the tree. The proposed approach is fully automated and the generated test cases satisfied the criteria defined for the generation process. The novelty of this approach is its systematic rather than ad hoc test case generation from UML diagrams to achieve high test coverage.

Web service composition is a mature and effective way to realize the rapidly changing requirements of business in service-oriented solutions. Testing the compositions of web services is complex, due to their distributed nature and asynchronous behaviour. Control flow testing focuses on the transfer of control, while data flow testing focuses on the definitions of data and their subsequent use. The execution of a service is driven by the received and manipulated data; hence validation of data flow is very critical in composition. Colored Petri Nets (CPNs) is one model that combines data and control flow with behavioural aspects of a given business requirement. In this paper, a test framework based on a data-driven CPN model for functional testing of web service composition is proposed. The test framework also includes test design coverage measurement using three newly formulated metrics: Decision Coverage, Input Output Coverage and Implementation Coverage. The framework was applied to airline reservation system and the generated test sequences were evaluated against the coverage criteria.

Studies on the testing techniques required during process of black box testing in embedded system have been increasing tremendously. This paper suggests test model and test case generation method for model based testing of embedded system. Considering the complicated internal architecture and real-time characteristics of embedded system, test cases are generated by using the state based behavior modeling method. The proposed state transition model based test case generation method suggests systematic procedures ranged from the use case specification to the test case generation. Entire procedure of test case generation in MP3 player case which uses the suggested method is presented in this paper. With the created test cases, the interaction among the components of embedded system can be easily figured out, thereby helping easy error detection. Moreover, the test cases applied with characteristics and constraints of embedded system could be achieved by modeling system behavior using SysML.

We propose a local search based approach to generate automatically test cases for programs having floating point statements. The proposed approach, called MLFP (for Multi-precision arithmetic and Local search for Floating Point constraints), adopts a local search approach to solve constraints on floating point numbers. Compared to the classical integer domain, floating point numbers F have two particular properties: they have a huge cardinality (e.g., 252 numbers in the interval [0.5, 1.0] with the "double" format), huge values (e.g. 10300), and also tiny values (e.g. 10-300). This huge combinatorial nature of the search space motivates using a local search approach. In order to find test cases containing huge or tiny numbers, such as overflow or underflow exception errors, MLFP uses the multiple precision MPFR library. Our local search approach proceeds in two steps. The first step exploits a line search algorithm to converge quickly to an approximate solution on real numbers. The second step adopts a dedicated local search algorithm on floating point numbers in order to find an exact solution, by using specific neighborhood and evaluation functions. We have implemented the MLFP approach, and we have shown its usefulness on various non trivial programs having floating point statements.

Formal methods and testing are two important approaches that assist in the development of cyber physical systems. Formal specification can be used to assist testing and Formal methods and testing are seen as complementary. In this paper, we address the problem of generating test cases for cyber physical systems from formal specifications using differential dynamic logic(DL), a logic for specifying and verifying hybrid systems.

A challenging part of Software Testing entails the generation of test cases, whose costs can be reduced by means of the use of techniques for automating this task. On the other hand, the nature of Software Engineering problems is ideal for the application of metaheuristic techniques. In this paper we present an approach based on the metaheuristic technique Scatter Search for the automatic test case generation of BPEL business processes using a transition-pair coverage criterion. The test case generator is called TCSS-LS-for-BPEL and it combines a diversity property with a local search. The diversity property is used to extend the search of test cases in order to reach different transitions of the business process. The local search is used to intensify the search when the diversification has problems to find test cases that cover transitions that have not been covered yet. We present the results obtained by our test case generator using two sample compositions and carry out a comparison with a random generator. The results indicate that TCSS-LS-for-BPEL can be used in the generation of test cases for BPEL business processes.

Combinatorial testing has been proved to be an efficient strategy in software testing. The research on automatic test case generation for system level based on components with constraints is a challenging but significant problem by using combinatorial testing. This paper focuses on the test case generation for system level based on components with sequential constraints. There are three main contributions: 1) the new test case generation strategy for system level is proposed based on IPOG (In-Parameter-Order-General) algorithm; 2) a filling strategy for don’t care positions is given to enhance the higher strength coverage for system level, which can improve the quality of the generated test suite; 3) a randomized post-optimization algorithm is applied to reduce the size of the test suite for system level. Experimental results show that the proposed filling strategy can improve the quality of the covering array, the post-optimization algorithm has a good optimization effect on reducing the size of the array, and trades off better between the size of the covering array and computational time than simulated annealing (SA).

To generate test cases for the unit testing of business process written in BPEL, developers have to prepare input data for the BPEL process under test (PUT) and verification conditions for output data from the PUT. It could be a tedious task due to the complexity of the PUT which describes the web flow of a distributed collaboration of individual service providers executing concurrently. This paper shows how Stream X-machine (SXM) based testing techniques could be applied to automatically generate test cases for BPEL process. The SXM describes a system as a finite set of states, an internal memory and a number of transitions between the states. One of the strengths of using a SXM to specify a system is that, under certain well defined conditions, it is possible to produce a test suite that is guaranteed to determine the correctness of the implementation under test.

To ensure software quality software testing is done .Test data generation is one of the more expensive parts of software testing. So, for reducing software cost and development time automation of test data generation is required. The object-oriented paradigm can be challenging for generating test data, due to some aspects of its features like abstract class, encapsulation, inheritance and visibility. To reach high code coverage of object oriented code search based test data generation technique is used. Proposed approach show that how efficiency and effectiveness of search based test data generation using static analysis. System takes input as different java class files then instances are generated for that classes then generate sequence of method call for whole code coverage then using genetic algorithm which is very useful and work efficiently when there is large search space it use to reach test target and finally generate test cases in Junit format which are helpful for all developers to perform unit testing.

The advancement of generative AI technologies has significantly impacted various domains in software engineering, particularly in automating test case generation. As software systems become increasingly complex, manual test case creation faces limitations in terms of efficiency and coverage. This study analyzes the capabilities and limitations of major generative AI models—ChatGPT, Copilot, and Gemini—in generating software test cases. We focus on evaluating their performance in boundary value analysis, exception handling, and property-based testing. Using the ArrayUtils.indexOf() function from the Apache Commons Lang library as the test subject, we conducted experiments to compare the quality and effectiveness of the test cases generated by each model. Our findings indicate that while generative AI can efficiently produce a substantial number of high-quality test cases, there are instances of incorrect test cases and test codes. To address these issues, we propose guidelines for developers to enhance the reliability and consistency of test case generation using generative AI. Future research will explore the application of these models to more complex software systems and further methods to improve their test generation capabilities.

It is still not sufficient for the famous embedded software test methods such as Finite State Machine, Software Cost Reduction and model coverage based test case generation, to pinpoint where bugs hang around and to figure out what makes the bugs. A new approach to ameliorate the drawbacks is proposed in this paper. In the approach, we define a generic model for embedded software. And we also define failure mechanism for embedded software, and a way to generate test cases based on it.

QoS monitoring is a kind of real-time systems which allows each level of the system to track the ongoing QoS levels achieved by the lower network layers. For these systems, real-time communications between corresponding transport protocol objects is essential for their correct behavior. When two or more entities are employed to perform a certain task as in the case of communication protocols, the capability to do so is called interoperability and considered as the essential aspect of correctness of communication systems. This paper describes a formal approach on modeling and interoperability test case generation of a real-time QoS monitoring protocol. For this, we specify the behavior of flow monitoring of transport layer QoS protocol, i.e., METS protocol, which is proposed to address QoS from an end-to-end's point of view, based on QoS architecture model which includes ATM net work in lower layers. We use a real-time Input/Output finite State Machine to model the behavior of real-time flow monitoring over time. From the modeled real-time I/OFSM, we generate interoperability test cases to check the correctness of METS protocol's flow monitoring behaviors for two end systems. A new approach to efficient interoperability testing is described and the method of interoperability test cases generation is shown with the example of METS protocol's flow monitoring. The current TTCN is not appropriate for testing real-time and multimedia systems. Because test events in TTCN are for message-based system and not for stream-based systems, the real-time in TTCN can only be approximated. This paper also proposes the notation of real-time Abstract Test Suite by means of real-time extension of TTCN. This approach gives the advantages that only a few syntactical changes are necessary, and TTCN and real-time TTCN are compatible. This formal approach on interoperability testing can be applied to the real-time protocols related to IMT-2000, B-ISDN and real-time systems.

오늘날 GUI가 소프트웨어의 성공에 중요한 영향을 미침으로써 GUI에 대한 테스트가 요구된다. 반면에 소프트웨어의 GUI 테스트는 많은 노력과 시간이 소비된다. 이러한 자원의 소비를 줄이기 위해 GUI 테스트를 자동으로 수행하는 것이 필요하다. 본 논문에서는 GUI 자동 테스트를 수행하기 위해 극복해야 할 문제와 GUI 자동 테스트에 적용되는 기술에 대해 논하고, Record-Playback 기술을 이용하여 GUI 테스트 케이스 자동 생성 방법을 제시한다.