Some metamorphic relations （MR） are not good at detecting faults in metamorphic testing. In this paper, the method of making compositional MR （CMR） based on the speculative law of proposition logic is presented. T...Some metamorphic relations （MR） are not good at detecting faults in metamorphic testing. In this paper, the method of making compositional MR （CMR） based on the speculative law of proposition logic is presented. This method constructs new MRs by composing existing MRs in a pairwise way. Because CMR contains all the advantages of the MRs that form it, its fault detection performance is wonderful. On the other hand, the number of relations will decrease greatly after composing, so a program can be tested with much fewer test cases when CMRs are used. In order to research the characteristics of a CMR, two case studies are analyzed. The experimental results show that the CMR＇s performance is mostly determined by the central MRs forming it and the sequence of composition. Testing efficiency is improved greatly when CMRs are used.展开更多
Software configuration testing is used to test a piece of software with all kinds of hardware to ensure that it can run properly on them. This paper generates test cases for configuration testing with several common m...Software configuration testing is used to test a piece of software with all kinds of hardware to ensure that it can run properly on them. This paper generates test cases for configuration testing with several common methods, such as multiple single-factor experiments, uniform design, and orthogonal experiment design used in other fields. This paper analyzes their merits and improves the orthogonal experiment design method with pairwise testing, and decreases the testing risk caused by incomplete testing with a method of multiple-factors-covering. It presents a simple factor cover method which can cover all the factors and pairwise combinations to the greatest degree. Some comparisons of these methods are made on the aspects of test suite scale, coverage, and usability, etc..展开更多
By analyzing the average percent of faults detected （APFD） metric and its variant versions, which are widely utilized as metrics to evaluate the fault detection efficiency of the test suite, this paper points out so...By analyzing the average percent of faults detected （APFD） metric and its variant versions, which are widely utilized as metrics to evaluate the fault detection efficiency of the test suite, this paper points out some limitations of the APFD series metrics. These limitations include APFD series metrics having inaccurate physical explanations and being unable to precisely describe the process of fault detection. To avoid the limitations of existing metrics, this paper proposes two improved metrics for evaluating fault detection efficiency of a test suite, including relative-APFD and relative-APFDc. The proposed metrics refer to both the speed of fault detection and the constraint of the testing source. The case study shows that the two proposed metrics can provide much more precise descriptions of the fault detection process and the fault detection efficiency of the test suite.展开更多
Selection of test cases plays a key role in improving testing efficiency. Black-box testing is an important way of testing, and its validity lies on the selection of test cases in some sense. A reasonable and effectiv...Selection of test cases plays a key role in improving testing efficiency. Black-box testing is an important way of testing, and its validity lies on the selection of test cases in some sense. A reasonable and effective method about the selection and generation of test cases is urgently needed. This letter first introduces some usualmethods on black-box test case generation,then proposes a new algorithm based on interface parameters and discusses its properties, finally shows the effectiveness of the algorithm.展开更多
基金The National Natural Science Foundation of China(No.60425206,60633010,60773104,60503033)the Excellent Talent Foundation of Teaching and Research of Southeast University
文摘Some metamorphic relations （MR） are not good at detecting faults in metamorphic testing. In this paper, the method of making compositional MR （CMR） based on the speculative law of proposition logic is presented. This method constructs new MRs by composing existing MRs in a pairwise way. Because CMR contains all the advantages of the MRs that form it, its fault detection performance is wonderful. On the other hand, the number of relations will decrease greatly after composing, so a program can be tested with much fewer test cases when CMRs are used. In order to research the characteristics of a CMR, two case studies are analyzed. The experimental results show that the CMR＇s performance is mostly determined by the central MRs forming it and the sequence of composition. Testing efficiency is improved greatly when CMRs are used.
文摘Software configuration testing is used to test a piece of software with all kinds of hardware to ensure that it can run properly on them. This paper generates test cases for configuration testing with several common methods, such as multiple single-factor experiments, uniform design, and orthogonal experiment design used in other fields. This paper analyzes their merits and improves the orthogonal experiment design method with pairwise testing, and decreases the testing risk caused by incomplete testing with a method of multiple-factors-covering. It presents a simple factor cover method which can cover all the factors and pairwise combinations to the greatest degree. Some comparisons of these methods are made on the aspects of test suite scale, coverage, and usability, etc..
基金The National Natural Science Foundation of China(No.61300054)the Natural Science Foundation of Jiangsu Province(No.BK2011190,BK20130879)+1 种基金the Natural Science Foundation of Higher Education Institutions of Jiangsu Province(No.13KJB520018)the Science Foundation of Nanjing University of Posts&Telecommunications(No.NY212023)
文摘By analyzing the average percent of faults detected （APFD） metric and its variant versions, which are widely utilized as metrics to evaluate the fault detection efficiency of the test suite, this paper points out some limitations of the APFD series metrics. These limitations include APFD series metrics having inaccurate physical explanations and being unable to precisely describe the process of fault detection. To avoid the limitations of existing metrics, this paper proposes two improved metrics for evaluating fault detection efficiency of a test suite, including relative-APFD and relative-APFDc. The proposed metrics refer to both the speed of fault detection and the constraint of the testing source. The case study shows that the two proposed metrics can provide much more precise descriptions of the fault detection process and the fault detection efficiency of the test suite.
基金Supported in part by the National Natural Science Foundation of China (NSFC)(60073012),Natural Science Foundation of Jiangsu(BK2001004)
文摘Selection of test cases plays a key role in improving testing efficiency. Black-box testing is an important way of testing, and its validity lies on the selection of test cases in some sense. A reasonable and effective method about the selection and generation of test cases is urgently needed. This letter first introduces some usualmethods on black-box test case generation,then proposes a new algorithm based on interface parameters and discusses its properties, finally shows the effectiveness of the algorithm.
