“Instruction-Category” Approach of Test Suite Construction for Oven Embedded System

Being different from testing for popular GUI software, the “instruction-category” approach is proposed for testing embedded system. This approach is constructed by three steps including refining items, drawing instruction-brief and instruction-category, and constructing test suite. Consequently, this approach is adopted to test oven embedded system, and detail process is deeply discussed. As a result, the factual result indicates that the “instruction-category” approach can be effectively applied in embedded system testing as a black-box method for conformity testing.

Guideline of Test Suite Construction for GUI Software Centered on Grey-Box Approach

In this paper, the test suite construction for GUI (Graphical User Interface) software may be executed centered on grey-box approach with the prior test design of window access controls for unit testing, including front-end method of white box and follow-up black box method for integration testing. Moreover, two key opinions are proposed for the test suite construction for GUI software, the first one is that the “Triple-step method” should be used for unit testing with the prior disposing of data boundary value testing of input controls, and another one is that the “Grey-box approach” should be applied in integration testing for GUI software with necessary testing preparation in the precondition. At the same time, the testing of baseline version and the incremental testing should be considered for the test case construction to coordinate with the whole evolution of software product today. Additionally, all our opinion and thought are verified and tested with a typical case of GUI software—PQMS (Product Quality Monitoring Software/System), and results indicate that these methods and specific disposing are practical and effective.

Principle and Design of a Test Suite Generation System——TSGS

Formal methods for test sequence generation from FSM have been studied widely andthoroughly,but most real communication systems can only be modeled as EFSM exactly.Data portion in EFSM brings difficulties for test suite generation.In this paper,the strategyof generating test suite from protocols modelled as EFSM is presented.This strategy consid-ers testing of both the control portion and data portion of protocols.A software,the testsuite generation system(TSGS)based on above strategy,is introduced.

Multi-Objective Modified Particle Swarm Optimization for Test Suite Reduction(MOMPSO)

Software testing plays a pivotal role in entire software development lifecycle.It provides researchers with extensive opportunities to develop novel methods for the optimized and cost-effective test suite Although implementation of such a cost-effective test suite with regression testing is being under exploration still it contains lot of challenges and flaws while incorporating with any of the new regression testing algorithm due to irrelevant test cases in the test suite which are not required.These kinds of irrelevant test cases might create certain challenges such as code-coverage in the test suite,fault-tolerance,defects due to uncovered-statements and overall-performance at the time of execution.With this objective,the proposed a new Modified Particle Swarm optimization used for multi-objective test suite optimization.The experiment results involving six subject programs show that MOMPSO method can outer perform with respect to both reduction rate(90.78%to 100%)and failure detection rate(44.56%to 55.01%).Results proved MOMPSO outperformed the other stated algorithms.

基于Test Suite TW软件研发的1000kN电子拉伸试验机低周疲劳测试方法

采用一台常规MTS 1 000kN电子拉伸试验机配置全自动引伸计、套筒式8 000psi液压夹具,配合MTS公司的Test Suite TW软件,设计研发出了一套可应力、应变控制的低周疲劳测试方法。该方法可对测试速率进行设置,实时显示、采集、复验波形,可在配备Test Suite控制软件的MTS电子拉伸试验机系统上推广,提供一套低成本的低周疲劳检测方案,特别适用于材料大应变、短时低周疲劳的日常检测。

SPIDER:Speeding up Side-Channel Vulnerability Detection via Test Suite Reduction

Side-channel attacks allow adversaries to infer sensitive information,such as cryptographic keys or private user data,by monitoring unintentional information leaks of running programs.Prior side-channel detection methods can identify numerous potential vulnerabilities in cryptographic implementations with a small amount of execution traces due to the high diffusion of secret inputs in crypto primitives.However,because non-cryptographic programs cover different paths under various sensitive inputs,extending existing tools for identifying information leaks to non-cryptographic applications suffers from either insufficient path coverage or redundant testing.To address these limitations,we propose a new dynamic analysis framework named SPIDER that uses fuzzing,execution profiling,and clustering for a high path coverage and test suite reduction,and then speeds up the dynamic analysis of side-channel vulnerability detection in non-cryptographic programs.We analyze eight non-cryptographic programs and ten cryptographic algorithms under SPIDER in a fully automated way,and our results confirm the effectiveness of test suite reduction and the vulnerability detection accuracy of the whole framework.

Modified condition decision coverage criteria for test suite prioritization using particle swarm optimization

Purpose–Test suite prioritization technique is the process of modifying the order in which tests run to meet certain objectives.Early fault detection and maximum coverage of source code are the main objectives of testing.There are several test suite prioritization approaches that have been proposed at the maintenance phase of software development life cycle.A few works are done on prioritizing test suites that satisfy modified condition decision coverage(MC/DC)criteria which are derived for safety-critical systems.The authors know that it is mandatory to do MC/DC testing for Level A type software according to RTCA/DO178C standards.The paper aims to discuss this issue.Design/methodology/approach–This paper provides a novel method to prioritize the test suites for a system that includes MC/DC criteria along with other important criteria that ensure adequate testing.Findings–In this approach,the authors generate test suites from the input Java program using concolic testing.These test suites are utilized to measure MC/DC%by using the coverage calculator algorithm.Now,use MC/DC%and the execution time of these test suites in the basic particle swarm optimization technique with a modified objective function to prioritize the generated test suites.Originality/value–The proposed approach maximizes MC/DC%and minimizes the execution time of the test suites.The effectiveness of this approach is validated by experiments on 20 moderate-sized Java programs using average percentage of fault detected metric.

A Usable Selection Range Standard Based on Test Suite Reduction Algorithms

In this paper, we analyze the features and distinctions of 6 classical algorithms： greedy algorithm （G）, greedy evolution algorithm （GE）, heuristics algorithm （H）, greedy heuristic G （GRE）, integer linear programming algorithm （ILP） and genetic algorithm （GA） to ensure the main influencing factors-the performance of algorithms and the running time of algorithms. What＇s more, we would not only present a research design that aims at gaining deeper understanding about the algorithm classification and its function as well as their distinction, but also make an empirical study in order to obtain a practical range standard that can guide the selection of reduction algorithms. When the size of a test object （product of test requirements and test cases） is smaller than 2000×2000, G algorithm is the commonly recommended algorithm. With the growth of test size, the usage of GE and GRE becomes more general.

基于CGA的MPI程序分支覆盖测试套件生成

针对程序的分支覆盖测试,元启发式搜索技术已经被广泛应用于测试数据生成中。然而,当前的研究成果主要适用于串行程序。因此,为覆盖消息传递接口(Message Passing Interface,MPI)程序的分支,该文研究基于协同进化遗传算法(Co-evolutionary Genetic Algorithm,CGA)的测试套件生成方法(简称为:CGA生成法),该方法具有不受不可行分支影响的优势。首先,基于收集覆盖信息的探针,定义最小归一化分支距离,并以此设计出相应的适应度值函数;然后,使用CGA生成进化个体,并基于设计的适应度值函数,计算这些个体的适应值;最后,基于计算的适应值,选择子种群中代表个体,以构成合作种群。所提CGA生成法应用于7个基准MPI程序,并与其他多种方法进行比较。实验结果表明,CGA生成法的覆盖率通常高于其他搜索算法。

测试集有效性评价:问题、进展与挑战

测试用例集的缺陷检测有效性指测试集能够在多大程度上检测出软件中存在的缺陷.如何评价测试集的缺陷检测有效性是一个重要问题.覆盖率和变异得分是两个最重要和最广泛使用的测试集有效性度量.为量化测试集的缺陷检测能力,研究人员对测试集有效性评价进行了大量研究并且取得了较大的进展.与此同时,现有研究存在不一致的结论,该领域依然存在一些亟待解决的挑战.对多年来国内外学者在测试集有效性评价领域的研究成果进行系统性的梳理和总结.首先,阐述测试集有效性评价研究中的问题.然后,介绍并分析基于覆盖率和基于变异得分的测试集有效性的评价以及介绍测试集有效性评价在测试集优化中的应用.最后,指出测试集有效性评价研究中面临的挑战并给出建议的研究方向.

Improved Test Case Selection Algorithm to Reduce Time in Regression Testing

Regression testing(RT)is an essential but an expensive activity in software development.RT confirms that new faults/errors will not have occurred in the modified program.RT efficiency can be improved through an effective technique of selected only modified test cases that appropriate to the modifications within the given time frame.Earlier,several test case selection approaches have been introduced,but either these techniques were not sufficient according to the requirements of software tester experts or they are ineffective and cannot be used for available test suite specifications and architecture.To address these limitations,we recommend an improved and efficient test case selection(TCS)algorithm for RT.Our proposed technique decreases the execution time and redundancy of the duplicate test cases(TC)and detects onlymodified changes that appropriate to themodifications in test cases.To reduce execution time for TCS,evaluation results of our proposed approach are established on fault detection,redundancy and already executed test case.Results indicate that proposed technique decreases the inclusive testing time of TCS to execute modified test cases by,on average related to a method of Hybrid Whale Algorithm(HWOA),which is a progressive TCS approach in regression testing for a single product.

Software Testing Method Based on Model Comparison

A model comparison based software testing method （MCST） is proposed. In this method, the requirements aria programs or software under test are transformed into the ones in the same form, and described by the same model describe language （MDL）. Then, the requirements are transformed into a specification model and the programs into an implementation model. Thus, the elements and structures of the two models are compared, and the differences between them are obtained. Based on the diffrences, a test suite is generated. Different MDLs can be chosen for the software under test. The usages of two classical MDLs in MCST, the equivalence classes model and the extended finite state machine （EFSM） model, are described with example applications. The results show that the test suites generated by MCST are more efficient and smaller than some other testing methods, such as the pathcoverage testing method, the object state diagram testing method, etc.

基于Daikon与C++Test的自动测试用例集约简工具生成

程序似然不变量是程序中隐含的属性,可以应用于程序验证、软件测试技术、逆向工程等领域。针对自动化测试工具C++Test产生的测试用例集,利用程序不变量分析工具Daikon判断这些测试用例是否改变了当前的不变量;并将两种工具结合生产一种自动化测试用例集约简工具CDRT(C++Test And Daikon Reduction Testing),从而达到约简测试用例集的效果,再通过变异测试工具INSURE++对简化后的测试用例集进行评估。实验结果表明,CDRT工具能有效地约简测试用例集。

QXDM Suite在WCDMA系统测试中的应用

在WCDMA系统测试中,分析手机日志是故障定位的重要手段之一。本文介绍了基于高通平台芯片的手机日志分析工具QXDM Suite,通过理论说明和部分典型测试用例验证,阐述了它在系统测试中的重要地位和应用。

Reusing Test Cases Based on the Function Point

Reusing test cases from existing test case library is quite common in the software testing field. Testing practice tells us that there is a strong relationship between the granularity of a function unit under testing and that of the test case. A function unit with small granularity usually results in the test cases with the same small granularity. Therefore a test case defined as the function point,i. e.,the smallest size function unit,was provided for the first time.Though test cases with smaller granularity usually have better reusability,the cost of accurately reusing and integrating such test cases is also higher. In order to balance the test case reusability and the cost of test case reuse,a novel test case reuse model based on the function point was proposed in this paper. In this model,a reusable test case for specification-based testing was defined and some reuse strategies and three formal reuse methods were given. Finally,the complete automatic software process was realized by a reusing generation tool. The new method has improved reuse accuracy,while greatly enhances the software productivity.

User Session-Based Test Case Generation and Optimization Using Genetic Algorithm

An approach to generating and optimizing test cases is proposed for Web application testing based on user sessions using genetic algorithm. A large volume of meaningful user sessions are obtained after purging their irrelevant information by analyzing user logs on the Web server. Most of the redundant user sessions are also removed by the reduction process. For test reuse and test concurrency, it divides the user sessions obtained into different groups, each of which is called a test suite, and then prioritizes the test suites and the test cases of each test suite. So, the initial test suites and test cases, and their initial executing sequences are achieved. However, the test scheme generated by the elementary prioritization is not much approximate to the best one. Therefore, genetic algorithm is employed to optimize the results of grouping and prioritization. Meanwhile, an approach to generating new test cases is presented using crossover. The new test cases can detect faults caused by the use of possible conflicting data shared by different users.

基于变异包容和关联规则的测试用例约简方法

针对存在冗余的测试用例使得回归测试中成本和工作量不断增加的问题,提出一种基于变异包容和关联规则的测试用例约简方法。利用生成的变异体和测试用例间的检测关系创建kill矩阵,根据kill矩阵中的动态包容关系去减少冗余的变异体,结合改进的Apriori算法挖掘测试用例间的关联规则来有效约简测试用例。该方法的平均测试用例约简率达到45%,采用6个经典程序与贪心算法、启发式算法进行对比实验,其平均约简率分别上升了7%、5%,运行测试所需时间分别下降了46.1%、38.4%。实验结果表明,该方法在约简测试用例方面具有有效性,并且能降低测试成本,提高测试效率。

面向全迁移的小规模EFSM测试序列集生成方法

针对在扩展有限状态机(extended finite state machine,EFSM)模型上测试序列集生成效率低、规模大等问题,提出了一种面向全迁移的小规模测试序列集生成方法。该方法基于改进的自适应多种群遗传算法(improved adaptive multi-population genetic algorithm,IAMGA)。首先,利用迁移覆盖增益设计适应度函数,使每次生成的可行迁移路径均能产生迁移覆盖增益;然后,根据个体的可行迁移划分子种群,并在子种群内使用轮盘赌算法进行选择,克服了“早熟”问题,提高了全迁移覆盖的成功率;再利用种群的平均路径通过率自适应地调整交叉和变异概率,加快了收敛速度;最后,通过倒序遍历测试序列集去除冗余序列,进一步压缩了测试序列集规模。实验结果表明,与面向单迁移的测试序列生成方法相比,本文所提出的测试序列生成方法面向全迁移,仅一次就能以90%以上的成功率生成满足全迁移覆盖的测试序列集;与传统的遗传算法相比,IAMGA算法生成的测试序列集的平均规模减少了50%,平均迭代次数也减少了20%。本文提出的测试序列集生成方法可有效提高EFSM测试序列集生成的效率和质量。

技术体制标准实施与符合性验证研究

针对当前技术体制的实施现状,结合实施过程中的问题,从标准实施要点编制、标准配套构件研制、测试用例集设计、标准配套测试工具研制等方面提出了标准实施与符合性验证思路,并以具体标准为例,给出了标准符合性验证工作的案例,为后续标准符合性验证工作提供指导。