摘要
针对AUV软件在部分可观环境中的故障修复问题,依据部分可观马尔科夫决策过程理论,提出基于POMDP模型和微重启技术的AUV软件故障修复方法。根据AUV分层结构特点设计了多层次的微重启修复方法,构建了AUV软件自修复POMDP模型,同时采用基于点的值迭代算法求解生成修复策略使系统在部分可观环境下能够以较低的修复代价执行修复动作。仿真实验验证了算法有效性和模型适用性。
According to the AUV software fault repair problem in partially observable environment, a method based on Partially Observable Markov Decision Process(POMDP)model and micro-reboot mechanism for solving failure repair of AUV is presented. AUV software self-repairing POMDP model is established based on the characteristics of AUV hierarchical structure while can design multi-level micro-reboot repair method. With the help of repair strategy which based on the algorithm of Point Based Value Iteration(PBVI), the system can implement the repair at lower repair cost in the partially observable environment. Results of experiment prove the validity of algorithm and the applicability of the model.
作者
张汝波
孟雷
史长亭
ZHANG Rubo;MENG Lei;SHI Changting(College of Computer Science and Technology, Harbin Engineering University, Harbin 150001, China;College of Electromechanical and Information Engineering, Dalian Nationalities University, Dalian, Liaoning 116600, China)
出处
《计算机工程与应用》
CSCD
北大核心
2017年第2期151-156,共6页
Computer Engineering and Applications
基金
国家部委预研基金
