连续时间Markov决策过程在呼叫接入控制中的应用

Continuous-time Markov Decision Processes to Call Admission Control Problem

应用 Markov决策过程与性能势相结合的方法 ,给出了呼叫接入控制的策略优化算法。所得到的最优策略是状态相关的策略 ,与基于节点已占用带宽决定行动的策略相比 ,状态相关策略具有更好的性能值 。

An algorithm to optimize policy in call admission control is presented by using the method of Markov decision processes combined with performance potentials. The optimal policy obtained by this algorithm is a state-depended policy. Compared to the policy decided by the used bandwidth, this policy has better performance. Furthermore, the convergence speed of this algorithm is very fast.