Development of a Model Driven ACSI Conformance Testing for IEC 61850-Based IED

Globally, traditional power systems are rapidly transforming towards the adoption of smart grid platforms. Substations which are at the center of the electric power transformation from the power plant are changing to IEC 61850 based digital substations. Therefore, within substation, there is a growing demand for the IEC 61850 based Intelligent Electronic Devices (IEDs). The operation of multiple manufacturers of IEDs in a single digital substation network increases the need for IEC 61850 communications specification conformance diagnosis to ensure interoperability for efficient data exchange between IEDs. The IEC 61850-10 presents test items for diagnosing communication specification conformance. There are many test tools available in the market today to test the compliance of the IEC 61850 communications specifications to the IED. In this paper, we propose a model-based diagnostic method for IED communication conformance testing. The proposed model-based software therefore uses the “drag and drop” technique to select the various IEC 61850 communication services (objects) required to design the test case in a user friendly Graphical User Interface (GUI). This makes the service conformance testing more flexible for test engineers and system integrators especially in situations that require test case modifications. Also, the proposed software tool makes it easy to understand the various IEC 61850 services using the friendly GUI.

The Protocol Conformance Testing of CCSS7 ISUP

This paper describes the ISUP (ISDN User Part of CCSS7) conformance testing theory and method according to CCITT and China national standards, and presents a successful ISUP protocol conformance testing system in detail.

Conformance Test for IEDs Based on IEC 61850 Communication Protocol

In this paper, a conformance test platform is built for intelligent electronic devices (IEDs) from different manufacturers based on IEC 61850 communication protocol. A conformance test of time delay of message transmission between two IEDs, made by the same or different manufacturers, is performed. The conformance test platform, as well as the test results provide a helpful reference for IEC 61850 implementation.

A Formal Model of Conformity and Security Testing of Inheritance for Object Oriented Constraint Programming

This paper presents an approach for extending the constraint model defined for conformity testing of a given method of class to its overriding method in subclass using inheritance principle. The first objective of the proposed work is to find the relationship between the test model of an overriding method and its overridden method using the constraint propagation. In this context the approach shows that the test cases developed for testing an original method can be used for testing its overriding method in a subclass and then the number of test cases can be reduced considerably. The second objective is the use of invalid data which do not satisfy the precondition constraint and induce valid output values for introducing a new concept of test called secure testing. The implementation of this approach is based on a random generation of test data and analysis by formal proof.

UML2.0 Testing Profile到TTCN-3的映射研究

分析了U2TP与标准化测试描述语言测试和测试控制标记法之间的对应关系,提出了一种从U2TP到测试和测试控制标记法的映射方法,并给出了一个图书馆借阅系统的应用实例。应用该映射方法,可在建模初期基于系统模型构造完整的测试思想,从而在初始阶段就能够有效限定测试例的数量并产生真正有价值的测试例。

AN ALGORITHM FOR AUTOMATICALLY GENERATING BLACK-BOX TEST CASES

Selection of test cases plays a key role in improving testing efficiency. Black-box testing is an important way of testing, and its validity lies on the selection of test cases in some sense. A reasonable and effective method about the selection and generation of test cases is urgently needed. This letter first introduces some usualmethods on black-box test case generation,then proposes a new algorithm based on interface parameters and discusses its properties, finally shows the effectiveness of the algorithm.

Timing issues in distributed testing

The objective of conformance testing is to determine whether an implementation under test (IUT) conforms to its specification. In distributed test architecture where there are multiple remote testers, the objective can be complicated by the fact that testers may encounter controllability and observability problems during the application of a test sequence. A certain amount of work has been done in the area of generating test sequence that is free from these problems. However, few researchers investigate them from the aspect of test execution. This work studies the test execution phase when test sequences are applied to the imple- mentation and it is pointed out that controllability and observability problems can be resolved if and only if the test system im- plements some timing constraints. When determining these constraints, the dynamic time information during test is taken into account, which reduces the test execution time and improves test efficiency further.

A Study on Unified Testing Method for IEC 61850 Based Server with Focus on Setting Group Function

The digital substation system consists of an Intelligent Electronic Device (IED) which requires information for the supervision, protection, and control, as well as a client operating system for substation operation. IEC 61850 communication standard has been defined for information exchange between heterogeneous digital devices in such substations. Currently, the Korea Electric Power Corporation (KEPCO) digital substation system uses unbuffered reporting and Generic Object Oriented Substation Events (GOOSE) communication functions for monitoring, protection and control automation. However, it is expected that the Setting Group function will be needed to operate adaptive intelligent substation system. The Setting Group function is advantageous in that it is possible to change the setting of the IED in one unified way through the client operating system, rather than changing the correction value of an IED through different manufacturer-based engineering tools. In order to utilize the Setting Group function of the IED in real substation scenario, it is necessary to test both the communication function with the host operating device and the electric functional test to ensure that correction value is properly changed. In this paper, we introduce the IEC 61850 Setting Group function, and propose a method that can integrate communication function and electrical function test of an IED conforming to the setting group functionality. We also tested the Setting Group function of the actual IED device through the proposed integrated functional test method and analyzed the results. We were able to simplify the process of testing both the electrical and communication signals in digital substations.

Review of Model-Based Testing Approaches in Production Automation and Adjacent Domains—Current Challenges and Research Gaps

As production automation systems have been and are becoming more and more complex, the task of quality assurance is increasingly challenging. Model-based testing is a research field addressing this challenge and many approaches have been suggested for different applications. The goal of this paper is to review these approaches regarding their suitability for the domain of production automation in order to identify current trends and research gaps. The different approaches are classified and clustered according to their main focus which is either testing and test case generation from some form of model automatons, test case generation from models used within the development process of production automation systems, test case generation from fault models or test case selection and regression testing.

A Study on the Testing Procedures of IEC 61850 Based Transformer Protective lED

Korea Electric Power Corporation in charge of the power IT project ＂Development of Prototype for Advanced Substation Automation System based on the Digital Control Technology＂, is performing the verification of performance of the substation automation system based on IEC 61850. In order to verify a transformer protective lED that might be operating in substation automation system, the new standardized document and procedures are required in the aspect of the utility like KEPCO. But there is nothing to describe systematically how to verify IEC 6 1850 based lED in the system environment except an individual IED testing way. This paper will present the substation automation system based ways and procedures to verify the protective function of the IED using UML （Unified Modeling Language）.

SIP Conformance Testing Based on TTCN-2

The session initiation protocol (SIP) is a signaling protocol for Internet telephony, multimedia conferencing, presence, event notification, and instant messaging. With the gaining popularity, more and more SIP implementations have been developed and deployed. How to guarantee the conformance of those SIP implementations is the key point of interconnection and interoperation among them. This paper proposes the test method and architecture for the SIP protocol based on the IPv6 tester system. Tree and tabular combined notation (TTCN-2) is adopted to describe the test suite. With an enhanced reference implementation, the data-processing ability to the original test system has been greatly improved. In the following test practices, some errors have been found in the SIP entities under test. It is proved that the proposed test method and architecture are effective to verify the conformance of the SIP entities, and the result of the conformance test may provide helpful reference to the development of SIP products.

Conformance testing of FMI calling sequence for simulation environments

Exchanging simulation models is currently of utmost importance.To improve interoperability between suppliers and original equipment manufacturers(OEMs),the functional mock-up interface(FMI)is exchanged in a standard format called functional mock-up unit(FMU).Since its first release,many simulation tools took the initiative to support FMI.However,since then,there have been many complaints stating that exchanging models via FMI does not work as stable as expected.The reason usually turned out to be the implementation of tool vendors that sometimes fail to comply with the standard fully.This paper introduces a methodology for testing FMI compliance of importing simulation tools using a set of reference FMUs.The standard defines the implementation of FMI functions calling sequence in a state machine.Therefore,conformance testing(also called fault detection)from automata theory is utilized to produce reference FMUs based on the FMI state-machine.

Principle and Design of a Test Suite Generation System——TSGS

Formal methods for test sequence generation from FSM have been studied widely andthoroughly,but most real communication systems can only be modeled as EFSM exactly.Data portion in EFSM brings difficulties for test suite generation.In this paper,the strategyof generating test suite from protocols modelled as EFSM is presented.This strategy consid-ers testing of both the control portion and data portion of protocols.A software,the testsuite generation system(TSGS)based on above strategy,is introduced.

<i>Inmap-t</i>: Leveraging TTCN-3 to Test the Security Impact of Intra Network Elements

This paper rejuvenates the notion of conformance testing in order to assess the security of networks. It leverages the Testing and Test Control Notation Version 3 (TTCN-3) by applying it to a redefined notion of System under Test (SUT). Instead of testing, as it is classically done, a software/firmware/ hardware element, an intangible object, namely the network, is tested in order to infer some of its security properties. After a brief introduction of TTCN-3 and Titan, its compilation and execution environment, a couple of use cases are provided to illustrate the feasibility of the approach. The pros and cons of using TTCN-3 to implement a scalable and flexible network testing environment are discussed.

Improving Laboratory Test-Ordering with Information Technology

The overuse of clinical laboratory services has been documented for many years. This overuse use does not contribute to the quality of medical care, does not shorten hospital stay, nor reduce mortality. The utilization of diagnostic laboratories has increased over the last decade around the world. This increased laboratory use is appropriate if it allows accurate diagnoses to be made, ideal treatment to be identified and monitored, accurate prognoses to be established, and patients’ hospital stays to be shortened. Thus, improving the appropriateness of testing behavior and reducing the number of laboratory tests have been recognized as essential parts of quality improvement program. In this study, the effectiveness of a computer-based system in improving the laboratory test-ordering in a general hospital was investigated. The study was conducted through four stages, the preparation stage, the pre-intervention stage, the post-intervention 1) stage and post-intervention 2) stage. Guideline and computer system were developed during preparation stage. Medical records were reviewed against guideline recommendations before any intervention during the pre-intervention stage, after guideline dissemination through educational workshops during the post intervention 1) stage, and after implementation of the computer system with the new requesting form during the post intervention 2) stage. The study revealed that the computer-based system achieved a statistically significant increase in the percentage of appropriate use from 44.6% in the post-intervention 1) stage to 55.6%, and a statistically significant increase in the compliance with guideline by prescriber as well as increased in guideline conformity rate from 16.7% in the post-intervention 1) stage to 32.5% in the post-intervention 2) stage, and decreased in the percentage of prescribers whose level was unsatisfactory from 85.4% the post-intervention 1) stage to 66.7% in the post-intervention 2) stage.

OFtest开源测试工具分析与应用

OFtest是思博伦公司和印第安纳大学inCNTER实验室联合推出的OpenFlow交换机协议一致性测试工具,是基于Python实现的开源项目,OFtest是基于Python实现的开源项目,已成为SDN最流行的测试工具之一。该文从系统实现的角度,对OFtest进行了分析,并详细说明了系统框架、控制模块、数据模块、测试辅助模块4个部分;从实际应用的角度,介绍了本地虚拟交换机的测试方法和设计测试用例需要遵循的规则,并提出了面向POF交换机的扩展建议。

超协调元

该文提出一类超协调的单元理论。不同于在普通协调元中采用的线位移协调插值格式,超协调元的单元插值函数首先引入转角自由度等线位移导数的高阶协调假设,并通过积分推导,进而获得超协调的线位移模型。基于超协调元理论,该文构造了一类新型的三结点三角形平板壳元SCT。数值算例表明:与其他类型单元相比,基于超协调元理论的单元具有计算精度高和计算效率好的优势。该文所提出单元理论构造简单,超协调元理论可以成为构造高性能数值算法的一种新的通用理论。

基于符合性证据链的航电系统工程试验方法

为形成逻辑严密、可追溯的适航符合性验证资料,提出一种基于符合性证据链的航电系统工程试验方法,并对实现中的关键问题进行分析研究。以自动飞行控制系统的工程试验为例,设计与实现了基于自动飞行控制系统适航验证需求的验证平台。在验证方案设计中,针对复杂验证环境中部分参数不确定性描述问题,提出一种基于分类概率多场景分析的验证方案设计方法,基于适航验证需求,对飞行数据进行筛选,通过对筛选后的飞行数据进行统计特性分析、随机抽样与合并缩减,生成包含发生概率的确定性场景,描述验证环境中部分参数的不确定性。在验证数据分析中,针对多场景多参数条件下的适航符合性判断问题,提出基于加权Dempster-Shafer证据理论的适航符合性评估方法,以确定性场景发生概率为权重,进行证据融合,避免部分小概率场景对融合结果的干扰。基于实际飞行数据,自动飞行控制系统的自动飞行模式工程试验结果表明,所提方法有效可行。

5G直放站射频自动测试系统的设计与实现

直放站具有同时放大5G上下行信号的功能,电信运营商将其视为延伸5G网络覆盖能力的优选方案,但在部署前必须开展选型测试。5G直放站的射频指标测试的工作量较大、测试数据多,人工测试时间长,且容易产生操作误差和辐射影响。为了提升5G直放站射频测试的效率、准确性和安全性,设计并实现了一套5G直放站射频自动测试系统,具备灵活制定测试方案、自动执行测试流程、准确判定测试结果、快速输出测试报告等功能,切实简化了5G直放站射频指标的测试复杂性,提高了电信运营商进行产品选型测试的效率和准确性。

基于时间约束的CAN网络管理一致性测试

汽车网络管理是现代汽车必不可少的基础功能。随着智能网联汽车的兴起,ECU数量的增加使得车载网络系统的需求和复杂性不断提高。为了确保网络管理的安全性和稳定性,需要全面的测试解决方案。本研究在深入理解AUTOSARCAN网络管理规范的基础上,提出一种针对AUTOSAR CAN网络管理的测试方法。首先基于AUTOSAR提供的标准TTCN-3测试脚本搭建测试系统,设计不定长测试报文,实现对CAN网络管理的多场景测试。其次基于巴科斯范式定义一种新的语法格式,对TTCN-3进行时间约束,提高对CAN网络报文的监测准确度。利用此方法,在基于MPC5745B平台的实际测试中,定位到3处异常信息,评估了AUTOSAR CAN网络管理的安全性和稳定性。实验结果表明,该方法能够在节省测试软硬件资源的情况下,全面测试AUTOSAR CAN网络管理的一致性。