A Specification-Based Case Study from Test Class Framework

Testing is a standard method for verification of software performance. Producing efficient and appropriate test case is an important aspect in testing. Specification based testing presents a method to derive test data from software specification. Because of the precision and concision of specification, the test data derived from specification can test the software efficiently and entirely. This paper demonstrates a test class framework(TCF) on a file reading case study, specified using Z notation. This test class framework defines test case sets, providing structure to the testing process. Flexibility is preserved so that many testing strategies can be used.

An Integration Testing Framework and Evaluation Metric for Vulnerability Mining Methods

Software an important way to vulnerability mining is detect whether there are some loopholes existing in the software, and also is an important way to ensure the secu- rity of information systems. With the rapid development of information technology and software industry, most of the software has not been rigorously tested before being put in use, so that the hidden vulnerabilities in software will be exploited by the attackers. Therefore, it is of great significance for us to actively de- tect the software vulnerabilities in the security maintenance of information systems. In this paper, we firstly studied some of the common- ly used vulnerability detection methods and detection tools, and analyzed the advantages and disadvantages of each method in different scenarios. Secondly, we designed a set of eval- uation criteria for different mining methods in the loopholes evaluation. Thirdly, we also proposed and designed an integration testing framework, on which we can test the typical static analysis methods and dynamic mining methods as well as make the comparison, so that we can obtain an intuitive comparative analysis for the experimental results. Final- ly, we reported the experimental analysis to verify the feasibility and effectiveness of the proposed evaluation method and the testingframework, with the results showing that the final test results will serve as a form of guid- ance to aid the selection of the most appropri- ate and effective method or tools in vulnera- bility detection activity.

Framework for Extensible Application Testing

In recent years large corporations as well as smaller commercial enterprises have begun to devote increased attention to software testing and software quality. This paper introduces a novel tool—the Framework for Extensible Application Testing (FEAT), implemented by the author and applicable for automatic generation and execution of test cases. The paper discusses system requirements, design, architecture and modes of operation. It also contains a detailed comparison of the FEAT framework with existing test environments, focusing in particular on the STAF/STAX framework. The final section is devoted to experimental research into the applicability and efficiency of the presented tools in various projects and configurations, as reflected by quality metrics.

Testability Estimation of Framework Based Applications

Quality of software systems is highly demanded in today’s scenario. Highly testable system enhances the reliability also. More than 50% of test effort-time and cost are used to produce a highly testable system. Thus, design-for-testability is needed to reduce the test effort. In order to enhance the quality, productivity and reduced cost of the software organizations are promoting to produce the reuse-oriented products. Incorporating reuse technology in both aspects-software development process and test process may payoff many folds. Keeping this view, our study focus the testability of the object-oriented framework based software systems and identify that flexibility at the variable points of the object-oriented framework, chosen for framework instantiation, greatly affects the testability of object-oriented framework based software at each level of testing. In the current paper, we propose a testability model considering the flexible aspect of the variable point to estimate testability in the early phase, requirement analysis phase, of development process of the framework based software. The proposed model helps to improve the testability of the software before the implementation starts thus reducing the overall development cost.

An Agent-Based Framework for Automated Testing of Web-Based Systems

Parallel to the considerable growth in applications of web-based systems, there are increasing demands for methods and tools to assure their quality. Testing these systems, due to their inherent complexities and special characteristics, is complex, time-consuming and challenging. In this paper a novel multi-agent framework for automated testing of web-based systems is presented. The main design goals have been to develop an effective and flexible framework that supports different types of tests and utilize different sources of information about the system under test to automate the test process. A prototype of the proposed framework has been implemented and is used to perform some experiments. The results are promising and prove the overall design of the framework.

Security Framework for Managing Data Security within Point of Care Tests

Point of Care (PoC) devices and systems can be categorized into three broad classes (CAT 1, CAT 2, and CAT 3) based on the context of operation and usage. In this paper, the categories are defined to address certain usage models of the PoC device. PoC devices that are used for PoC testing and diagnostic applications are defined CAT 1 devices;PoC devices that are used for patient monitoring are defined as CAT 2 devices (PoCM);PoC devices that are used for as interfacing with other devices are defined as CAT 3 devices (PoCI). The PoCI devices provide an interface gateway for collecting and aggregating data from other medical devices. In all categories, data security is an important aspect. This paper presents a security framework concept, which is applicable for all of the classes of PoC operation. It outlines the concepts and security framework for preventing security challenges in unauthorized access to data, unintended data flow, and data tampering during communication between system entities, the user, and the PoC system. The security framework includes secure layering of basic PoC system architecture, protection of PoC devices in the context of application and network. Developing the security framework is taken into account of a thread model of the PoC system. A proposal for a low-level protocol is discussed. This protocol is independent of communications technologies, and it is elaborated in relation to providing security. An algorithm that can be used to overcome the threat challenges has been shown using the elements in the protocol. The paper further discusses the vulnerability scanning process for the PoC system interconnected network. The paper also presents a four-step process of authentication and authorization framework for providing the security for the PoC system. Finally, the paper concludes with the machine to machine (M2M) security viewpoint and discusses the key stakeholders within an actual deployment of the PoC system and its security challenges.

课程思政背景下基于TPACK框架的软件测试课程教学探索

基于软件测试课程教学中存在的问题,为提升教师专业素养和改善教学质量,提出以TPACK理论框架为指导归纳该课程的教师知识结构,构建融入课程思政的混合式教学改革方案。以闽江学院软件工程专业本科教学中的课程教改实践为例,对教学效果进行评价。

基于Robot Framework测试框架的机载娱乐系统自动化测试设计

在对机载娱乐系统软件架构进行分析的基础上,阐明了机载娱乐系统自动化测试的必要性,设计了基于Robot Fra-mework测试框架的自动化分层测试组织结构,明确了自动化测试中测试用例、测试规程、测试结果之间的追踪性,并将设计的测试组织结构在实际项目中进行了应用。实践表明,采用所设计的自动化分层测试组织结构可以较好的满足机载娱乐系统在软件测试过程中的脚本维护、扩展、稳定测试等要求,有利于软件的快速交付。

轻量级嵌入式软件自动化测试框架设计

为满足嵌入式软件测试过程中测试数据的快速生成与输入,采用数据与关键字驱动的混合驱动方法对嵌入式软件自动化测试框架进行设计。通过对嵌入式软件自动化测试框架的研究,明确测试框架设计的难点;对软件测试数据的组成与结构进行分析,构建数据与关键字驱动模型并对其生成与输入算法进行设计,根据模型实现复杂多接口测试数据的快速生成与输入。采用模块化思想,利用多线程原理对该轻量级测试框架进行设计与实现,通过实例验证该框架能够实现测试数据的自动生成与快速输入,提升测试效率。

基于Cypress的医疗Web平台自动化测试设计与实现

目的 把自动化测试应用于医疗Web平台(以下简称医疗平台),以提高医疗平台测试的效率并保证平台的稳定性。方法 分析Cypress原理及流程,搭建测试框架,并编写测试用例,再结合Cypress自动化测试框架编写测试代码,将自动化测试覆盖医疗平台的各个关键功能模块。结果 根据实际测试验证分析,随着回归测试量增多(回归测试大于3时),自动化测试相较于手动测试,能够显著提高测试效率。使用两项系统功能进行多次手动和自动化对比测试,结果显示,自动化测试速度明显快于手动测试,差异具有统计学意义(P<0.001)。结论 基于Cypress框架的医疗平台自动化测试是一种有效的测试方案,可提高医疗平台的测试效率,为医疗平台开发测试提供了可靠的技术参考。

深度学习框架测试研究综述

随着大数据和计算能力的快速发展,深度学习技术取得巨大突破,并迅速成为一个具有众多实际应用场景和活跃研究课题的领域.为了满足日益增长的深度学习任务开发需求,深度学习框架应运而生.深度学习框架作为连接应用场景和硬件平台的中间部件,向上支撑深度学习应用的开发,帮助用户快速构造不同的深度神经网络模型,向下深度适配各类计算硬件,满足不同算力架构和环境下的计算需求.作为人工智能领域的关键基础软件,深度学习框架中一旦存在问题,即使是一个只有几行代码的缺陷都可能导致在其基础上构造的模型发生大规模失效,严重威胁深度学习系统安全.作为以深度学习框架测试为主题的研究性综述,首先对深度学习框架发展历程和基本架构进行介绍;其次,通过对55篇与深度学习框架测试研究直接相关的学术论文进行梳理,对深度学习框架缺陷特性、测试关键技术和基于不同测试输入形式的测试方法这3个方面进行系统分析和总结;针对不同测试输入形式的特点,重点探究如何结合测试关键技术来解决研究问题;最后对深度学习框架测试尚未解决的难点问题进行总结以及对未来值得探索的研究方向进行展望.可以为深度学习框架测试研究领域的相关人员提供参考和帮助,推动深度学习框架的不断发展成熟.

基于Robot Framework的自动化接口测试框架的设计与实现

目前国产软件的接口测试主要采用的是通过使用串口或网口报文收发工具进行测试的方法。该方法通常需要人工发送报文,并逐个字节比对接收到的报文和接口协议的一致性,这大大地增加了测试的时间和人力成本。针对该问题,该文提出了一种基于Robot Framework的自动化接口测试框架,可自动进行接口测试的各项操作。文章详细介绍了该框架的设计原理和实现过程,并结合具体的应用实例验证该测试框架的可行性。使用该测试框架可提高测试效率、降低测试成本。

单元测试框架GTest的自动调用机制分析

单元测试框架是测试驱动开发模式中的核心工具,当前的研究主要集中在单元测试框架的使用方法,对框架的实现原理研究较少。研究了谷歌公司的开源测试框架GTest的自动调用机制,首先概述了GTest框架的核心技术,然后以自带的Sample1为例,研究了测试用例注册、测试用例执行过程的信息调度,最后研究了GTest的测试执行情况监听机制。

基于RobotFramework的RESTful WebAPI自动化测试框架设计与研究

随着互联网时代的不断发展,软件开发模式也在发生着变革,前后端分离越来越明显,支持前后端分离的关键环节是WebAPI技术的广泛使用。在WebAPI开发中,RESTful风格的JSON格式轻量级接口模式以其简单实用等的特点,更受开发者青睐。因而针对此类接口的测试自动化就显得尤为重要,基于这一原因,本文主要介绍了一个应用于RESTful WebAPI的自动化测试框架的设计与实现。

基于框架的Web服务软件自动化测试技术

为弥补传统手动Web服务软件测试周期长、效率低等缺点,设计一种基于框架的Web服务软件自动化测试技术。介绍测评体系结构,设计Web服务自动化测试框架;基于该框架进行综合安全监管系统软件的自动化测试技术应用研究,在软件需求分析的基础上进行测试数据设计,并自动生成测试用例;利用自动化测试框架实现数据驱动脚本自动测试,列出测试用例执行结果并分析软件问题。结果表明,该技术能缩短软件测试周期、提高测试效率和测试覆盖率。

智能动力平台多型复杂气象模拟仿真测试框架

针对智能动力平台在恶劣复杂气象条件下的仿真测试评价问题,提出了一种基于知识图谱的典型气象-交通要素数字化表征方法,并设计了智能动力平台多型复杂气象模拟仿真框架。首先分析了智能动力平台测试评价的现状和挑战,介绍了现有的智能控制仿真平台及其局限性。然后利用知识图谱结构化和语义化的特性,系统地划分和描述了复杂气象条件和交通场景,为仿真测试提供了数据支撑。最后采用“同图式”的方式,有效地融合和呈现了不同气象条件和交通场景,为智能动力平台在各种复杂情况下的性能评估提供了支撑平台。

大数据序贯检验方法及其应用

分布的一致性检验在很多领域中得到了广泛的应用,它是统计学在众多应用中的一个基本主题。然而,随着大数据时代的到来,各个科学领域收集存储了丰富的数据。这些数据规模庞大、类型多样、结构复杂、更新速度快,传统的分布一致性检验方法受数据规模和存储方式的影响在处理和分析这类数据时面临着巨大的挑战。目前,分治策略是解决这类问题的主要方法,其核心思想是采用分布式框架对每个节点数据的计算结果进行集成以获取最终的结果。在处理大规模分布一致性检验问题时,这种对所有节点的检验结果进行集成的方式并不高效,特别是在数据分布存在明显差异时这种方式往往会增加检验的成本。因此,基于序贯检验的思想通过合理设置检验问题的“误差区域”对已有的分治策略进行优化,提出了一种分布式序贯检验方法。该方法在检验过程中不集成所有的节点数据,而是根据当前收集到的节点数据实时调整后续的决策,通过这种方式能够实现在不使用全部节点数据的前提下,做出正确的检验结果。模拟实验和实例分析结果表明:相比于已有的分治策略检验方法,所提出的分布式序贯检验方法能够在保证检验水平与功效的同时,提高分布式检验的计算效率,为解决临床试验、工业检验等领域中大规模数据检验成本高的问题提供了方法支撑。

LKJ自动测试平台及关键技术研究

列车运行监控装置(LKJ)是我国现阶段普速铁路应用最为广泛的车载设备之一,随着铁路运输需求的不断提升,作为保障行车安全,提高运输效率的关键设备,LKJ设备变得愈发重要。为解决LKJ设备人工测试过程工作量大、效率低下,难以找寻故障原因等问题,设计一种LKJ自动测试平台并对其关键技术进行研究。自动测试平台基于传统的人工测试流程进行优化,采用图形化方式生成测试用例,设计信号适配单元模拟设备运行条件,增加人机交互单元简化测试操作,基于Robot Framework自动测试框架及故障分析专家系统自动执行测试并给出故障原因,实现可无人值守的自动化测试。通过LKJ-15型设备及实验室仿真环境进行验证,结果表明,自动测试平台可取代传统仿真测试中部分人工操作,对故障现象进行分析给出指导意见,有效提升了测试效率。

一种约束制导的机器学习框架漏洞检测方法

随着机器学习在社会各领域中自主决策场景的广泛应用,人们对机器学习框架中潜在漏洞的担忧也在日益增加.然而,由于其复杂的实现,针对框架的系统化、自动化测试成为一项艰巨的任务.现有对机器学习框架测试的研究在生成有效测试数据方面尚不成熟,导致测试数据无法通过合法性校验并因此无法检测到目标漏洞.本文提出了ConFL,一种基于约束的机器学习框架模糊测试工具.ConFL能够自动从框架源代码中提取约束而无需任何先验知识.在约束的指导下,ConFL可以生成能够通过校验的有效输入,并执行到框架更深层次的代码逻辑.此外,本文设计了一种算子分组调度技术来提高模糊测试的效率.为了证明ConFL的有效性,本文主要在Tensor-Flow框架上评估了其性能.测试发现,与现有的SOTA工具相比,ConFL能够覆盖更多的代码行,并生成更多有效的测试数据;在相同版本的TensorFlow框架上,ConFL能检测出更多的已知漏洞.此外,ConFL在不同版本的TensorFlow中发现了84个未知漏洞,这些漏洞全部被官方修复并被分配了CVE编号,其中包括3个严重漏洞,13个高危漏洞.最后,本文还在PyTorch和PaddlePaddle中进行了通用性测试,迄今为止发现了7个漏洞.

基于人工智能的自动化测试框架设计与实现

随着软件系统的日益复杂,传统的软件测试方法面临着提高效率和准确性的双重挑战。文章提出一种基于人工智能(Artificial Intelligence,AI)的自动化测试框架,旨在通过机器学习和自然语言处理技术,提高测试用例的生成效率和测试覆盖率。该框架集成多种AI算法,能够根据软件的历史数据和结构信息,智能生成测试用例,并进行缺陷预测。实际的软件项目测试结果表明,该框架能够显著提高测试效率,同时保持较高的缺陷检出率。