Modeling and simulation(M&S)play a critical role in both engineering and basic research processes.Computer-based models have existed since the 1950s,and those early models have given way to the more complex comput...Modeling and simulation(M&S)play a critical role in both engineering and basic research processes.Computer-based models have existed since the 1950s,and those early models have given way to the more complex computational and physics-based simula-tions used today.As such,a great deal of research has been done to establish what level of trust should be given to simulation outputs and how to verify and validate the mod-els used in these simulations.This paper presents an overview of the theoretical work done to date defining formal definitions for,and methods of,verification and validation(V&V)of computer models.Simulation models are broken down into three broad cate-gories:analytical and simulation models,computational and physics-based models,and simulations of autonomous systems,and the unique theories and methods developed to address V&V of these models are presented.This paper also presents the current prob-lems in the theoretical field of V&V for models as simulations move from single system models and simulations to more complex simulation tools.In particular,this paper high-lights the lack of agreed-upon methods for V&V of simulations of autonomous systems,such as an autonomous unmanned vehicles,and proposes some next steps needed to address this problem.展开更多
In this paper,we propose an approach to formally verify and rigorously validate a simulation system against the specification of the real system.We implement the approach in a verification and validation calculator to...In this paper,we propose an approach to formally verify and rigorously validate a simulation system against the specification of the real system.We implement the approach in a verification and validation calculator tool that takes as input a set of statements that capture the requirements,internal conditions of the system and expected outputs of the real system and produces as output whether the simulation satisfies the requirements,faithfully represents the internal conditions of the system and produces the expected outputs.We provide a use case to show how subject matter experts can apply the tool.展开更多
To better utilize the potential of system simulation models and simulators,industrially applicable methods for Verification,Validation and Uncertainty Quantification(VV&UQ)are crucial.This paper presents an explo...To better utilize the potential of system simulation models and simulators,industrially applicable methods for Verification,Validation and Uncertainty Quantification(VV&UQ)are crucial.This paper presents an exploratory case study of VV&UQ techniques applied on models integrated in aircraft system simulators at Saab Aeronautics and in driving simulators at the Swedish National Road and Transport Research Institute(VTI).Results show that a large number of Verification and Validation(V&V)techniques are applied,some of which are promising for further development and use in simulator credibility assessment.Regarding the application of UQ,a large gap between academia and this part of industry has been identified,and simplified methods are needed.The applicability of the NASA Credibility Assessment Scale(CAS)at the studied organizations is also evaluated and it can be concluded that the CAS is considered to be a usable tool for achieving a uniform level of V&V for all models included in a simulator,although its implementation at the studied organizations requires tailoring and coordination.展开更多
Computer programs have been categorized as a useful tool to evaluate the complexity of systems. In fact, agent-based modeling (ABM) is considered a new method to model complex systems characterized by the role of inde...Computer programs have been categorized as a useful tool to evaluate the complexity of systems. In fact, agent-based modeling (ABM) is considered a new method to model complex systems characterized by the role of independent and interrelating agents. Simulations contribute in estimating and comprehending emerging behaviors that require the development of new regulations for local agents that would make improvements to the system. This paper offers an example of a methodology and a process utilized to develop a simulation model named Befergyonet, an ABM used to conduct computer simulations within a spatio-intertemporal environment. The methodology discussed in this paper is intended solely to stimulate the use of innovative computer programs to simulate complex systems as an approach to represent real world events and may be a methodological guide for readers interested in developing their own ABM.展开更多
文摘Modeling and simulation(M&S)play a critical role in both engineering and basic research processes.Computer-based models have existed since the 1950s,and those early models have given way to the more complex computational and physics-based simula-tions used today.As such,a great deal of research has been done to establish what level of trust should be given to simulation outputs and how to verify and validate the mod-els used in these simulations.This paper presents an overview of the theoretical work done to date defining formal definitions for,and methods of,verification and validation(V&V)of computer models.Simulation models are broken down into three broad cate-gories:analytical and simulation models,computational and physics-based models,and simulations of autonomous systems,and the unique theories and methods developed to address V&V of these models are presented.This paper also presents the current prob-lems in the theoretical field of V&V for models as simulations move from single system models and simulations to more complex simulation tools.In particular,this paper high-lights the lack of agreed-upon methods for V&V of simulations of autonomous systems,such as an autonomous unmanned vehicles,and proposes some next steps needed to address this problem.
文摘In this paper,we propose an approach to formally verify and rigorously validate a simulation system against the specification of the real system.We implement the approach in a verification and validation calculator tool that takes as input a set of statements that capture the requirements,internal conditions of the system and expected outputs of the real system and produces as output whether the simulation satisfies the requirements,faithfully represents the internal conditions of the system and produces the expected outputs.We provide a use case to show how subject matter experts can apply the tool.
基金The research leading to these results has received funding from Saab Aeronautics and the Swedish Government Agency VINNOVA’s National Aviation Engineering Research Programme(NFFP62013-01211).
文摘To better utilize the potential of system simulation models and simulators,industrially applicable methods for Verification,Validation and Uncertainty Quantification(VV&UQ)are crucial.This paper presents an exploratory case study of VV&UQ techniques applied on models integrated in aircraft system simulators at Saab Aeronautics and in driving simulators at the Swedish National Road and Transport Research Institute(VTI).Results show that a large number of Verification and Validation(V&V)techniques are applied,some of which are promising for further development and use in simulator credibility assessment.Regarding the application of UQ,a large gap between academia and this part of industry has been identified,and simplified methods are needed.The applicability of the NASA Credibility Assessment Scale(CAS)at the studied organizations is also evaluated and it can be concluded that the CAS is considered to be a usable tool for achieving a uniform level of V&V for all models included in a simulator,although its implementation at the studied organizations requires tailoring and coordination.
文摘Computer programs have been categorized as a useful tool to evaluate the complexity of systems. In fact, agent-based modeling (ABM) is considered a new method to model complex systems characterized by the role of independent and interrelating agents. Simulations contribute in estimating and comprehending emerging behaviors that require the development of new regulations for local agents that would make improvements to the system. This paper offers an example of a methodology and a process utilized to develop a simulation model named Befergyonet, an ABM used to conduct computer simulations within a spatio-intertemporal environment. The methodology discussed in this paper is intended solely to stimulate the use of innovative computer programs to simulate complex systems as an approach to represent real world events and may be a methodological guide for readers interested in developing their own ABM.
