期刊文献+

基于时间策略的连续时间Markov过程验证 被引量:1

Model checking Continuous time Markov Process based on timed Schedulers
下载PDF
导出
摘要 对系统模型进行验证是保证系统安全的一个关键.连续时间Markov过程可以刻画复杂并发系统的随机、概率、不确定性特征.提出时间依赖策略下连续时间Markov过程验证方法,将连续时间Markov过程转换成为交互式马尔科夫链,给出模型的转换方法及不确定性选择策略的转换方法,最终通过求解交互式马尔科夫链的时间可达概率最值实现对连续时间Markov过程模型的验证.理论分析表明,提出的方法具有可行性. System validation before implement is more important for safety critical systems. Continuous-time Markov decision process (CTMDP) is a model that contains some aspects such as probabilistic choice, stochastic timing and nondeterministic choice. In this paper, model checking continuous time Markov process based on timed schedulers is proposed. Firstly, the formal conversions of model and their nondeterministic choices schedulers from continuous time Markov decision process to interactive Markov chains are introduced. After then we reduce the problem of model checking for continuous time decision process to the problem of computing the maximum time- bounded teachability probabilities of interactive Markov chains. The theoretical analysis shows that the proposed approach is feasibility.
出处 《广西科技大学学报》 CAS 2014年第3期59-62,86,共5页 Journal of Guangxi University of Science and Technology
基金 广西自然科学基金项目(2013GXNSFBA019280) 同济大学嵌入式与服务计算教育部重点实验室开放课题基金(2011-02) 广西高校科学技术研究项目(LX2014186)资助
关键词 马尔科夫决策过程 交互式马尔科夫链 时间有界可达概率 时间策略 Markov decision process interactive Markov chains time -bounded reachability probability timedschedulers
  • 相关文献

参考文献13

  • 1Baier C. Principles of Model Checking[M]. Massachusetts:The MIT Press,2008.
  • 2Baier C, Haverkort B, Hermanns H, et al. Model-checking Algorithms for Continuous Time Markov Chains [J ].IEEE Transaction on Software Engineering, 2003,29 (6) :524-541.
  • 3张环环,周丽娟.马尔科夫链在通信市场3G用户预测中的应用[J].广西工学院学报,2013,24(1):94-97. 被引量:5
  • 4Puterman M L. Markov Decision Processes:Discrete Stochastic Dynamic Programming [ M ]. New Jeasey:John Wiley&Sons, 1994.
  • 5Baier C, Hermanns H, Katoen JP, et al. Efficient Computation of Time-bounded Reachability Probabilities in Unitbrm Continuous- time Markov Decision Processes [J ].Theoretical Computer Science. 2005,345 ( 1 ) :2-26.
  • 6Johr S. Model Checking Compositional Markov Systems[D]. Saarbrucken Germany:Saarland University,2007.
  • 7钮俊,曾国荪,吕新荣,徐畅.随机模型检测连续时间Markov过程[J].计算机科学,2011,38(9):112-115. 被引量:2
  • 8黄镇谨,陆阳,杨娟,方欢.Markov决策过程不确定策略特征模式[J].计算机科学,2013,40(4):263-266. 被引量:2
  • 9Baier C, Haverkort Boudewijn R, Hermanns H et al. Reachability in Continuous-time Markov reward Decision Processes [C]// Proceedings of the Occasion of Wolfgang T homas's 60th Birthday. Aachen Germany:Amsterdam University Press, 2007:53-72.
  • 10Ash R B , Doleans-Dade C A. Probability & Measure Theory[M ]2nd edition: San Diego:Academic Press, 2000:215-275.

二级参考文献33

  • 1Clarke E M, Grumberg O, Peled D A. Model Checking [M]. Cambridge: MIT Press, 2000.
  • 2Baier C, Haverkort B, Hermanns H, et al. Model-checking algorithms for continuous time Markov chains[J]. IEEE Transaction on Software Engineering, 2003,29(6): 524-541.
  • 3Puterman M L. Markov Decision Processes: Discrete Stochastic Dynamic Programming[M]. New Jersey: John Wiley &Sons, 1994.
  • 4tMier C, Hermanns H, Katoen J-P, et al. Efficient computation of time-bounded reachability probabilities in uniform continuoustime Markov decision processes[J]. Theoretical Computer Science,2005,345(1) :2-26.
  • 5Hermanns H. Interactive Markov Chains[D]. Friedrich-Alexander-University. Erlangen-Nurnberg, 1998.
  • 6Baier C,Katoen J-P. Principles of Model Checking[M]. Massachusetts: The MIT Press, 2008.
  • 7Cloth L, Haverkort B, Hermanns H, et al. Model Checking path CSL[C]//Proe. of PMCCS-6. Illinois USA: September 2003:19- 22.
  • 8Baier C, Cloth L, Haverkort B, et al. Model Checking Markov Chains with Actions and State Labels[J].IEEE Transactions on Software Engineering, 2007,33 (4) : 209-224.
  • 9Markov Reward Model Checker Version 1.4. 1 Manual[OL]. http://www, mrmc-tool, org/downloads/MRMC/Specs/. 2009.
  • 10郑阿奇,曹弋.MATLAB实用教程[M].2版.北京:电子工业出版社,2009.

共引文献6

同被引文献18

引证文献1

二级引证文献15

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部