期刊文献+

Admission Control with Elastic QoS for Video on Demand Systems 被引量:3

Admission Control with Elastic QoS for Video on Demand Systems
原文传递
导出
摘要 In network service systems, satisfying quality of service (QoS) is one of the main objectives. Admission control and resource allocation strategy can be used to guarantee the QoS requirement. Based on partially observable Markov decision processes (POMDPs), this paper proposes a novel admission control model for video on demand (VOD) service systems with elastic QoS. Elastic QoS is also considered in resource allocation strategy. Policy gradient algorithm is often available to find the solution of POMDP problems, with a satisfactory convergence rate. Through numerical examples, it can be shown that the proposed admission control strategy has better performance than complete admission control strategy. In network service systems, satisfying quality of service (QoS) is one of the main objectives. Admission control and resource allocation strategy can be used to guarantee the QoS requirement. Based on partially observable Markov decision processes (POMDPs), this paper proposes a novel admission control model for video on demand (VOD) service systems with elastic QoS. Elastic QoS is also considered in resource allocation strategy. Policy gradient algorithm is often available to find the solution of POMDP problems, with a satisfactory convergence rate. Through numerical examples, it can be shown that the proposed admission control strategy has better performance than complete admission control strategy.
出处 《International Journal of Automation and computing》 EI 2012年第5期467-473,共7页 国际自动化与计算杂志(英文版)
基金 supported by National Natural Science Foundation of China (Nos. 61174124, 61233003 and 60935001) National High Technology Research and Development Program of China (863 Program) (No. 2011AA01A102)
关键词 Partially observable Markov decision processes (POMDPs) admission control resource allocation elastic quality of service (QoS) policy gradient Partially observable Markov decision processes (POMDPs), admission control, resource allocation, elastic quality of service (QoS), policy gradient
  • 相关文献

参考文献17

  • 1黄静,殷保群,李俊.基于观测的POMDP优化算法及其仿真[J].信息与控制,2008,37(3):346-351. 被引量:1
  • 2Xi-Ren Cao.Basic Ideas for Event-Based Optimization of Markov Systems[J]. Discrete Event Dynamic Systems . 2005 (2)
  • 3X. R. Cao.Single Sample Path-Based Optimization of Markov Chains[J]. Journal of Optimization Theory and Applications . 1999 (3)
  • 4Li Y J,Yin B Q,Xi H S.Partially observable Markovdecision processes and performance sensitivity analysis. IEEE Transactions on Systems,Man,andCybernetics-Part B:Cybernetics . 2008
  • 5H. T. Fang,X. R. Cao.Potential-based online policy iteration algorithms for Markov decision processes. IEEE Transactions on Automatic Control . 2004
  • 6K. W. Ross,D. Tsang.The stochastic knapsack problem. IEEE Transactions on Communications . 1989
  • 7K. W. Ross,D. Tsang.Optimal circuit access policies in an ISDN environment: A Markov decision approach. IEEE Transactions on Communications . 1989
  • 8F.Ma,W.N.Zhou,J.D.Song,G.X.Xu.Research on Admission Control Mechanism in Heterogeneous Network Platform. International Symposium on Intelligence Information Technology Application,IEEE . 2009
  • 9Hui Zhang,Xuming Fang.A Pricing and Game Theory-Based Call Admission Control Scheme for CDMA Systems. International Conference on Wireless Communications, Networking and Mobile Computing . 2007
  • 10B. Praveen,J. Praveen,C. S. R. Murthy.On providing elastic QoS in optical burst switched networks. Proceedings of 2nd International Conference on Broadband Networks . 2005

二级参考文献8

  • 1Aberdeen D A. Policy-Gradient Algorithms for Partially Observable Markov Decision Processes [D]. Canberra: The Australian National University, 2003.
  • 2Cassandra A R. Exact and Approximate Algorithms for Partially Observable Markov Decision Processes [D]. USA: Brown University, 1998.
  • 3Papadimitriou C H, Tsitsiklis J N. The complexity of Markov decision processes [J]. Mathematics of Operations Research, 1987, 12(3): 441-450.
  • 4Nourbakhsh I R, Powers R, Birchfield S. DERVISH: An officenavigating robot [J]. AI Magazine, 1995, 16(2): 53~60.
  • 5Simmons R, Koenig S. Probabilistic robot navigation in partially observable environments [A]. Proceedings of the International Joint Conference on Artificial Intelligence [C]. San Francisco, CA, USA: Morgan Kaufmann Publishers, 1995. 1080-1087.
  • 6Littman M L, Cassandra A R, Kaelbling L P. Learning policies for partially observable environments: Scaling up [A]. Proceedings of the Twelfth International Conference on Machine Learning [C]. San Francisco, CA, USA: Morgan Kaufmann Publishers, 1995. 362-370.
  • 7Cao X R. Basic ideas for event-based optimization of Markov systerns [J]. Discrete Event Dynamic Systems, 2005, 15(2): 169-197.
  • 8van Dijk N M. Queuing Networks and Product Forms: A Systems Approach [M]. New York, USA: John Wiley and Sons, 1993.

同被引文献28

引证文献3

二级引证文献4

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部