摘要
在无线传感器网络目标跟踪的过程中进行节点调度,可以综合考虑跟踪误差和能量消耗,延长传感器网络的使用寿命。为了综合考虑节点调度的短期和长远损失,该文将问题建模为部分可观测马尔科夫决策过程(POMDP)以得到更优的调度策略,并提出一种近似求解算法C-QMDP。该算法利用马尔科夫链蒙特卡洛方法(MCMC)推导连续状态空间的置信状态的转移,并计算瞬时代价。使用状态离散化方法,基于马尔科夫决策过程(MDP)值迭代求解未来代价的近似值。仿真结果表明,相比现有POMDP近似算法,该文算法既可以降低跟踪过程中的累积损失,又可以将大量运算进行离线计算,减小了在线决策时的计算量。
In the process of target tracking, the sensor scheduling algorithm can achieve the tradeoff between the tracking error and the energy consumption so as to extend the service life of the sensor network. The issue can be modeled as a Partially Observable Markov Decision Process (POMDP), which takes both short- and long- term losses of sensor scheduling into account and makes a better decision. A C-QMDP approximation algorithm suitable for continuous state space is proposed. The Markov Chain Monte Carlo (MCMC) method is used to derive the transfer function of belief state and calculate the instantaneous cost. The state discretization method is used to solve the approximation of future cost based on Markov Decision Process (MDP) iteration. Simulation results show that compared to the existing POMDP approximation algorithms, the proposed algorithm can reduce the cumulative losses and computation load in the tracking process by offline computation.
作者
胡波
王祺尧
冯辉
罗灵兵
HU Bo;WANG Qiyao;FENG Hui;LUO Lingbing(School of Information Science and Technology,Fudan University,Shanghai 20043;Research Center of Smart Networks and Systems,Fudan University,Shanghai 200433)
出处
《电子与信息学报》
EI
CSCD
北大核心
2018年第9期2033-2041,共9页
Journal of Electronics & Information Technology
基金
国家自然科学基金(61501124),上海市公安局科学技术发展基金(2017012)
关键词
无线传感器网络
目标跟踪
节点调度
部分可观测马尔可夫决策过程
Wireless Sensor Networks (WSN)
Target tracking
Sensor scheduling
Partially Observable Markov Decision Process (POMDP)