期刊文献+

Reinforcement learning models for scheduling in wireless networks 被引量:2

Reinforcement learning models for scheduling in wireless networks
原文传递
导出
摘要 The dynamicity of available resources and net- work conditions, such as channel capacity and traffic charac- teristics, have posed major challenges to scheduling in wire- less networks. Reinforcement learning (RL) enables wire- less nodes to observe their respective operating environment, learn, and make optimal or near-optimal scheduling deci- sions. Learning, which is the main intrinsic characteristic of RL, enables wireless nodes to adapt to most forms of dynamicity in the operating environment as time goes by. This paper presents an extensive review on the application of the traditional and enhanced RL approaches to various types of scheduling schemes, namely packet, sleep-wake and task schedulers, in wireless networks, as well as the advantages and performance enhancements brought about by RL. Addi- tionally, it presents how various challenges associated with scheduling schemes have been approached using RL. Finally, we discuss various open issues related to RL-based schedul- ing schemes in wireless networks in order to explore new re- search directions in this area. Discussions in this paper are presented in a tutorial manner in order to establish a founda- tion for further research in this field. The dynamicity of available resources and net- work conditions, such as channel capacity and traffic charac- teristics, have posed major challenges to scheduling in wire- less networks. Reinforcement learning (RL) enables wire- less nodes to observe their respective operating environment, learn, and make optimal or near-optimal scheduling deci- sions. Learning, which is the main intrinsic characteristic of RL, enables wireless nodes to adapt to most forms of dynamicity in the operating environment as time goes by. This paper presents an extensive review on the application of the traditional and enhanced RL approaches to various types of scheduling schemes, namely packet, sleep-wake and task schedulers, in wireless networks, as well as the advantages and performance enhancements brought about by RL. Addi- tionally, it presents how various challenges associated with scheduling schemes have been approached using RL. Finally, we discuss various open issues related to RL-based schedul- ing schemes in wireless networks in order to explore new re- search directions in this area. Discussions in this paper are presented in a tutorial manner in order to establish a founda- tion for further research in this field.
出处 《Frontiers of Computer Science》 SCIE EI CSCD 2013年第5期754-766,共13页 中国计算机科学前沿(英文版)
关键词 reinforcement learning SCHEDULING wireless networks reinforcement learning, scheduling, wireless networks
  • 相关文献

参考文献28

  • 1Sutton R S, Barto A G. Reinforcement learning: an introduction. US: MIT Press, 1998.
  • 2Stidham S J. Applied probability in operations research: a retrospec- tive//Preprint: analysis, design, and control of queueing systems. Op-eration Research, 2002, 50(1): 197-216.
  • 3Thompson M S, Mackenzie A B, Dasilva L A, Hadjichristofi G. A mobile ad hoc networking competition: a retrospective look at the MANIAC challenge. IEEE Communications Magazine, 2012, 50(7): 121-127.
  • 4Li X, Falcon R, Nayak A, Stojmenovic I. Servicing wireless sensor networks by mobile robots. IEEE Communications Magazine, 2012, 50(7): 147-154.
  • 5Xue Y, Lin Y, Cai H, Chi C. Autonomic joint session scheduling strategies for heterogeneous wireless networks. In: Proceedings of the 2008 IEEE Wireless Communications and Networking Confer- ence. 2008. 2045-2050.
  • 6Song M, Xin C, Zhao Y, Cheng X. Dynamic spectrum access: from cognitive radio to network radio. IEEE Wireless Communications, 2012, 19(1): 23-29.
  • 7Mao J, Xiang F, Lai H. RL-based superframe order adaptation algo- rithm for IEEE 802.15.4 networks. In: Proceedings of the 2009 Chi- nese Control and Decision Conference. 2009, 4708-4711.
  • 8Shah K, Kumar M. Distributed independent reinforcement learning (DIRL) approach to resource management in wireless sensor net- works. In: Proceedings of the 4th International Conference on Mobile Ad-hoc and Sensor Systems. 2007, 1-9.
  • 9Niu J. Self-learning scheduling approach for wireless sensor network. In: Proceedings of/he 2010 International Conference on Future Com- puter and Communication. 2010, 253-257.
  • 10Kaelbling L P, Littman M L, Wang X. Reinforcement/earning: a sur- vey. Journal of Artificial Intelligence Research, 1996, 4:237-285.

同被引文献3

引证文献2

二级引证文献5

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部