Development Methodologies for Network Softwarization: A Comparison of DevOps, NetOps, and Verification

This white paper explores three popular development methodologies for network softwarization: DevOps, NetOps, and Verification. The paper compares and contrasts the strengths and weaknesses of each approach and provides recommendations for organizations looking to adopt network softwarization.

Verification and validation of detonation modeling

The mathematical model used to describe the detonation multi-physics phenomenon is usually given by highly coupled nonlinear partial differential equations. Numerical simulation and the computer aided engineering (CAE) technique has become the third pillar of detonation research, along with theory and experiment, due to the detonation phenomenon is difficult to explain by the theoretical analysis, and the cost required to accredit the reliability of detonation products is very high, even some physical experiments of detonation are impossible. The numerical simulation technique can solve these complex problems in the real situation repeatedly and reduce the design cost and time stunningly. But the reliability of numerical simulation software and the serviceability of the computational result seriously hinders the extension, application and the self-restoration of the simulation software, restricts its independently innovational ability. This article deals with the physical modeling, numerical simulation, and software development of detonation in a unified way. Verification and validation and uncertainty quantification (V&V&UQ) is an important approach in ensuring the credibility of the modeling and simulation of detonation. V&V of detonation is based on our independently developed detonation multiphysics software-LAD2D. We propose the verification method based on mathematical theory and program function as well as availability of its program execution. Validation is executed by comparing with the experiment data. At last, we propose the future prospect of numerical simulation software and the CAE technique, and we also pay attention to the research direction of V&V&UQ.

对validation,verification和qualification三个质量管理术语之理解

目的针对目前药品行业对现代质量管理中的"确认(validation)"、"验证(verification)"和"鉴定(qualification)"等几个关于"确证"术语使用的混乱状况,探讨关于"确证"术语的含义及相互区别,强调药品领域正确应用这些术语的重要性。方法从这些术语的溯源开始,探讨其定义的内涵与外延、相互之间的关系以及中英文转化的标准化问题。结果与结论从"标准或规定要求"、"研发方"与"接受方"、"做事"等多角度—而不仅从活动类型角度—才能更好地理解这三个术语间的含义、联系和区别。

Lessons Learned from Practical Independent Verification and Validation Based on IEEE 1012

IEEE 1012 [1] describes the SDLC phase activities for software independent verification and validation (IV & V) for nuclear power plant in truly general and conceptual manner, which requires the upward and/or downward tailoring on its interpretation for practical IV & V. It contains crucial and encompassing check points and guidelines to analyze the design integrity, without addressing the formalized and the specific criteria for IV & V activities confirming the technical integrity. It is necessary to list up the inspection viewpoint via interpretation of the standard that is practical review points checking design consistency. For fruitful IV & V of Control Element Driving Mechanism Control System (CEDMCS) software for Yonggwang Nuclear Power Plant unit 3 & 4, the specific viewpoints and approach are necessary based on the guidelines of IEEE 1012 to enhance the system quality by considering the level of implementation of the theoretical and the practical IV & V. Additionally IV & V guideline of IEEE 1012 does not specifically provide the concrete measure considering the system characteristics of CEDMCS. This paper provides the seven (7) characteristic criteria for CEDMCS IV & V, and by applying these viewpoints, the design analysis such as function, performance, interface and exception, backward and forward requirement traceability analysis has been conducted. The requirement, design, implementation, and test phase were only considered for IV & V in this project. This article also provides the translation of code to map theoretical verification and validation into practical verification and validation. This paper emphasizes the necessity of the intensive design inspection and walkthrough for requirement phase to resolve the design faults because the IV & V of early phase of SDLC obviously contributes to find out most of critical design inconsistency. Especially for test phase IV & V, it is strongly recommended to prepare the test plan document which is going to be the basis for the test coverage selection and test strategy. This test plan document should be based on the critical characteristics of function and performance of CEDMCS. Also to guarantee the independency of V & V organization participating in this project, and to acquire the full package of design details for IV & V, the systematic approach and efforts with an aspect of management is highlighted among the participants.

A Survey on an Emerging Safety Challenge for Autonomous Vehicles:Safety of the Intended Functionality

As the complexity of autonomous vehicles(AVs)continues to increase and artificial intelligence algorithms are becoming increasingly ubiquitous,a novel safety concern known as the safety of the intended functionality(SOTIF)has emerged,presenting significant challenges to the widespread deployment of AVs.SOTIF focuses on issues arising from the functional insufficiencies of the AVs’intended functionality or its implementation,apart from conventional safety considerations.From the systems engineering standpoint,this study offers a comprehensive exploration of the SOTIF landscape by reviewing academic research,practical activities,challenges,and perspectives across the development,verification,validation,and operation phases.Academic research encompasses system-level SOTIF studies and algorithm-related SOTIF issues and solutions.Moreover,it encapsulates practical SOTIF activities undertaken by corporations,government entities,and academic institutions spanning international and Chinese contexts,focusing on the overarching methodologies and practices in different phases.Finally,the paper presents future challenges and outlook pertaining to the development,verification,validation,and operation phases,motivating stakeholders to address the remaining obstacles and challenges.

ProTSA: A Testing Process for Automotive Software Domain

This study evaluates the development of a testing process for the automotive software domain, highlighting challenges stemming from the absence of adequate processes. The research demonstrates the application of Design Science Research methodology in developing, an automotive software testing process—ProTSA, using six functional testing modules. Additionally, the study evaluates the benefits of implementing ProTSA in a specific Original Equipment Manufacturer (OEM) using an experimental single-case approach with industry professionals’ participation through a survey. The study concludes that combining testing techniques with effective communication and alignment is crucial for enhancing software quality. Furthermore, survey data indicates that implementing ProTSA leads to productivity gains by initiating tests early, resulting in time savings in the testing program and increased productivity for the testing team. Future work will explore implementing ProTSA in cybersecurity, over-the-air software updates, and autonomous vehicle testing processes. .

安全级仪控系统FPGA模块功能仿真测试V&V探讨

在核电仪控系统安全软件开发过程中,为了保证软件的安全性和可靠性,必须在开发生命周期中各阶段执行V&V工作。本文初步研究了FPGA开发过程中,针对模块功能仿真测试的V&V工作,着重讨论了如何建立仿真测试环境、建立测试用例实施模块功能测试,保证测试的有效性、完整性,并以一个FPGA模块实例说明模块功能仿真测试的具体过程。

Seasonal Prediction of Tropical Cyclones and Storms over the Southwestern Indian Ocean Region Using the Generalized Linear Models

Tropical cyclones (TCs) and storms (TSs) are among the devastating events in the world and southwestern Indian Ocean (SWIO) in particular. The seasonal forecasting TCs and TSs for December to March (DJFM) and November to May (NM) over SWIO were conducted. Dynamic parameters including vertical wind shear, mean zonal steering wind and vorticity at 850 mb were derived from NOAA (NCEP-NCAR) reanalysis 1 wind fields. Thermodynamic parameters including monthly and daily mean Sea Surface Temperature (SST), Outgoing Longwave Radiation (OLR) and equatorial Standard Oscillation Index (SOI) were used. Three types of Poison regression models (i.e. dynamic, thermodynamic and combined models) were developed and validated using the Leave One Out Cross Validation (LOOCV). Moreover, 2 × 2 square matrix contingency tables for model verification were used. The results revealed that, the observed and cross validated DJFM and NM TCs and TSs strongly correlated with each other (p ≤ 0.02) for all model types, with correlations (r) ranging from 0.62 - 0.86 for TCs and 0.52 - 0.87 for TSs, indicating great association between these variables. Assessment of the model skill for all model types of DJFM and NM TCs and TSs frequency revealed high skill scores ranging from 38% - 70% for TCs and 26% - 72% for TSs frequency, respectively. Moreover, results indicated that the dynamic and combined models had higher skill scores than the thermodynamic models. The DJFM and NM selected predictors explained the TCs and TSs variability by the range of 0.45 - 0.65 and 0.37 - 0.66, respectively. However, verification analysis revealed that all models were adequate for predicting the seasonal TCs and TSs, with high bias values ranging from 0.85 - 0.94. Conclusively, the study calls for more studies in TCs and TSs frequency and strengths for enhancing the performance of the March to May (MAM) and December to October (OND) seasonal rainfalls in the East African (EA) and Tanzania in particular.

药品质量管理术语validation、 verification和qualification语义研究

针对当前药品质量管理中validation、verification和qualification容易混淆和误译的现象,借助语料库软件AntConc,并经ABBYY Aligner处理,结合搭配理论,探讨这三个术语的语义区别以及如何规范化。建议在药品质量管理中,validation译为"验证",verification译为"确证",当探讨杂质问题时,qualification译为"界定",涉及设备或辅助系统时,qualification译为"确认"。

Design and Verification of FPGA-Based Applications in Nuclear Power Plants

Nuclear industries have faced the unfavorable circumstance such as components obsolescence and aging of instrumentation and control system, therefore, nuclear society is striving to resolve this issue fundamentally. Various studies have been conducted to address components obsolescence of instrumentation and control system. Intuitively FPGA （field programmable gate arrays） technology is replacing the high level of micro-processor type equipped with various software and hardware which causes acceleration of the aging and obsolescence in I ＆ C （instrumentation and control） system in nuclear power plants. FPGAs are highlighted as an alternative means for obsolete control systems. When engineers design the control system of NPPs （nuclear power plants） with FPGAs, it is important to meet the system development life cycles and conduct the verification and validation activities regarding to FPGA-based applications for use in NPPs. Because the verification and validation process is more important than the design process, engineer should consider the characteristics of FPGA, HDL （hardware description language） programming, faults mode, and optimization technique. And also these characteristics should be reflected in verification and validation activities. As a minimum requirement, system designers require that HDL-programmed applications should be developed in accordance with system development life cycle and HPD design process. In the verification and validation processes, a review, test, and analysis activities should be properly conducted.

核级系统、软件和硬件的V&V研究与应用

软件验证和确认(V&V)技术对于提高核电站安全级仪控系统的软件质量发挥着重要作用。在核安全级数字化控制系统(DCS)中,系统、硬件与软件三者同等重要且密不可分,因此有必要将系统和硬件也纳入V&V的范围。讨论了针对核安全级DCS中系统、软件和硬件的V&V标准体系,提出融合新核安全导则HAD 102/10—2021和新工业标准IEEE Std 1012^(TM)-2016关于生命周期要求的V&V过程模型,并阐述了3类V&V活动之间的交互关系及系统V&V和硬件V&V中的重点任务。该研究成果在自主化核安全级仪控平台和睦系统的研制及某核电站DCS工程典型项目的成功应用中,取得了良好效果。其满足核安全级DCS的质量控制需求,同时也符合HAD 102/10—2021的新监管要求。该研究为我国核行业实施系统和硬件的V&V提供了技术借鉴,有助于提升产品安全性和可靠性,也对其他高可靠性领域系统的质量控制有重要参考意义。

基于FPGA的核电厂保护系统V&V方法研究

核电厂保护系统的设计是功能验证和应用软件开发需求的源头,而基于现场可编程门阵列(FPGA)技术开发的保护系统应用则是对保护功能的分解实施和最终实现。针对验证和确认(V&V)全生命周期过程进行了研究,结合保护系统功能设计和基于FPGA技术的功能应用实施,建立了一套完整的V&V方法,明确了每个活动环节的主要任务,提出了面向核电厂保护系统FPGA应用的V&V方法和框架方案。结合目前工程承包项目实施模式,对V&V工作的实施策略给出了优化方向和改进建议。

CFD V&V and Open Benchmark Database

CFD verification and validation （V＆V） are fundamental activities of credibility analysis for aerodynamic simulations. Through these activities, a large number of data resources will be generated. How to efficiently manage and utilize these treasures is the key problem for benchmark database. In this paper an operable design of open benchmark database is studied and proposed with emphasis on administration, availability, data reliably, unified data standards and open system architecture. The purpose is to provide a paradigm of aerodynamic open benchmark database for CFD V＆V, and to overcome some universal obstacles in current aerodynamic database such as lacks of coordination, continuity and necessary communication. Besides, some recent efforts of credibility analysis for aerodynamic simulations in China are briefly introduced.

国外仿真VV&A标准综述

随着信息技术的进步,建模与仿真技术迅速发展并得到广泛应用,而仿真能否代表真实世界成为用户十分关注的问题。仿真的校核、验证与确认(VV&A)是保证仿真正确性和可信性的关键,而仿真VV&A标准为VV&A工作的开展、VV&A活动的规范等提供指导。首先对国外仿真VV&A标准的发展历程进行总结,进而从应用目的、术语定义、设计思路等方面对国外仿真VV&A典型标准进行比较分析,最后在对国内外仿真VV&A标准简要对比的基础上,展望未来仿真VV&A标准的发展方向。

In silico studies of magnesium-based implants: A review of the current stage and challenges

In silico methods to study biodegradable implants have recently received increasing attention due to their potential in reducing experimental time and cost. An important application case for in silico methods are magnesium(Mg)-based biodegradable implants, as they represent a powerful alternative to traditional materials used for temporary orthopaedic applications. Controlling Mg alloy degradation is critical to designing an implant that supports the bone healing process. To simulate different aspects of this biodegradation process, several mathematical models have been proposed with the ultimate aim of replacing laboratory experiments with computational modeling. In this review, we provide a comprehensive and critical discussion of the published models and their performance with respect to capturing the complexity of the biodegradation process. This complexity is presented initially. Additionally, the present review discusses the different approaches of optimizing and quantifying the different sources of errors and uncertainties within the proposed models.

Verifying Monoid and Group Morphisms over Strongly Connected Algebraic Automata

Automata theory has played an important role in theoretical computer science since last couple of decades. The alge-braic automaton has emerged with several modern applications, for example, optimization of programs, design of model checkers, development of theorem provers because of having certain interesting properties and structures from algebraic theory of mathematics. Design of a complex system requires functionality and also needs to model its control behavior. Z notation has proved to be an effective tool for describing state space of a system and then defining operations over it. Consequently, an integration of algebraic automata and Z will be a useful computer tool which can be used for modeling of complex systems. In this paper, we have linked algebraic automata and Z defining a relationship between fundamentals of these approaches which is refinement of our previous work. At first, we have described strongly connected algebraic automata. Then homomorphism and its variants over strongly connected automata are specified. Next, monoid endomorphisms and group automorphisms are formalized. Finally, equivalence of endomorphisms and automorphisms under certain assumptions are described. The specification is analyzed and validated using Z/Eves toolset.

Some notes on numerical investigation of three cavitation models through a verification and validation procedure

The present paper investigates the turbulent cavitating flow around the Clark-Y hydrofoil with special emphasis on the influence of cavitation models by verification and validation(V&V)method.RANS solver coupled with the three major cavitation models(i.e.,Zwart-Gerber-Belamri,Schnerr and Sauer and full cavitation model,which are abbreviated to ZGB model,SS model and FC model respectively)is employed in this paper.The results indicate that the three cavitation models can properly reproduce the cavitation evolutions.ZGB model and SS model give better prediction in the overall cavitation patterns.FC model exhibits an obvious under-estimation for the sheet cavity,and the predicted volume fraction is closely related to the turbulent flow.The verification and validation procedure is involved to quantitatively assess the accuracy of these three cavitation models.It is indicated that the V&V procedure is suitable for the unsteady cavitating flow.The errors estimate is robust and conservative within the cavitation region,while gets closer to zero in the no-cavitation region.In addition,ZGB model exhibits the highest overall accuracy among the three models,which further verifies its wide applicability.

仿真系统的校核、验证与验收(VV&A):现状与未来

对仿真系统的校核、验证与验收问题进行了详细的介绍。首先对仿真系统校核、验证与验收的历史发展文献情况进行了简要的综述；然后，详细讨论了仿真系统校核、验证与验收的有关概念和原则；对仿真系统校核、验证与验收的过程和方法作了认真的分析与比较；并对仿真系统校核、验证与验收计算机辅助系统作了简要的介绍。最后，对仿真系统校核。

复杂大系统仿真的VV&A理论及过程研究

为了确保复杂大系统仿真(LCSS)的可信性,应该在建模与仿真(M&S)的全生命周期中开展校核、验证与确认(VV&A)研究。对LCSS的VV&A进行了理论研究,提出其方法论与原则;以基于仿真组件构建的HLA仿真系统为例,从仿真组件层、联邦成员层及联邦层三个层面研究了VV&A过程,并将这些研究应用于反舰导弹突防联邦仿真中。实践表明,研究对LCSS的VV&A工作具有很好的指导作用,有力地保障了仿真的可信性。