期刊文献+

支持服务区分的多智能体Q学习MAC算法 被引量:4

Q-learning MAC Algorithm of Multi-agent Supporting Service Differentiation
下载PDF
导出
摘要 媒体访问控制(MAC)协议负责协调所有认知用户的空闲信道接入服务,是认知Ad-hoc网络支持服务质量(QoS)的关键技术之一。在二进制指数退避算法基础上,提出一种支持服务区分的多智能体Q学习MAC算法。实时调整传输概率,使系统信道接入服务达到最优,建立传输概率调节的Markov链模型,导出分组的传输概率与协议参数的关系,给出基于服务区分的信道吞吐率模型,建立基于MAC协议参数学习的多智能体Q学习算法。实验结果表明,该算法能满足高优先级业务的QoS,且吞吐率和时延性能优于IEEE 802.11e EDCA机制。 The Media Access Control(MAC) protocol which coordinates idle channel accessing service among cognitive radio users,is one of the key technologies in cognitive Ad-hoc network supporting Quality of Service(QoS).This paper is based on the algorithm of binary exponential backoff,proposes a MAC algorithm with multi-agent Q-learning that supports service differentiation,real-time transmission probability adjusting is introduced to optimum the accessing service of system.Markov chain model is established with transmit probability adjusting,and the relationship between packet transmit probability and protocol parameters are derived.The channel throughput model with service differentiation is given.The multi-agent Q-learning architecture based on MAC protocol parameter is realized.Experimental result shows that this algorithm can satisfy the QoS of high priority service,the throughput rate and delay are better than IEEE 802.11e EDCA mechanism.
出处 《计算机工程》 CAS CSCD 2013年第8期112-116,120,共6页 Computer Engineering
基金 国家自然科学基金资助项目(61072138) 四川省科技厅应用基础研究基金资助项目(2010jy0173)
关键词 服务区分 Q学习 多智能体 认知无线电 媒体访问控制 传输概率 service differentiation Q-learning multi-agent Cognitive Radio(CR) Media Access Control(MAC) transmission probability
  • 相关文献

参考文献10

  • 1Mitola J.Cognitive Radio:An Integrated Agent Architecturefor Software Defined Radio[D].Stockholm,Sweden:RoyalInstitute of Technology,2000.
  • 2Haykin S.Cognitive Radio:Brain-empowered Wireless Com-munications[J].IEEE Transactions on Selected Areas inCommunications,2005,23(2):201-220.
  • 3Huang Yuqing,Jiang Hong,Hu Hong,et al.Design ofLearning Engine Based on Support Vector Machine inCognitive Radio[C]//Proc.of International Conference onComputational Intelligence and Software Engineering.Wuhan,China:[s.n.],2009.
  • 4Huang Yuqing,Wang Jiao,Jiang Hong.Modeling of LearningInference and Decision-making Engine in CognitiveRadio[C]//Proc.of the 2nd International Conference onNetworks Security,Wireless Communications and TrustedComputing.Wuhan,China:[s.n.],2010.
  • 5Aad I,Castelluccia C.Differentiation Mechanisms for IEEE802.11[C]//Proc.of the 20th Annual Joint Conference of theIEEE Computer and Communications Societies.[S.l.]:IEEEPress,2001.
  • 6Muir A,Garcia J J.Supporting Real-time Multimedia Trafficin a Wireless LAN[C]//Proc.of SPIE’97.[S.l.]:SPIE Press,1997.
  • 7Su Hang,Zhang Xi.Cross-layer Based Opportunistic MACProtocols for QoS Provisionings Over Cognitive RadioWireless Networks[J].IEEE Journal on Selected Areas inCommunications,2008,26(1):118-129.
  • 8Song Hua,Lin Xiaola.A Group Based MAC Protocol for QoSProvisioning in Cognitive Radio Networks[C]//Proc.of the11th IEEE Singapore International Conference on Communi-cation Systems.[S.l.]:IEEE Press,2008.
  • 9冯文江,陈倩,李林,沈嘉皓.认知无线电网络分布式多信道MAC协议[J].计算机应用研究,2011,28(2):639-641. 被引量:6
  • 10Hu Junling,Wellman M P.Nash Q-learning for General-sumStochastic Games[J].The Journal of Machine LearningResearch,2003,4:1039-1069.

二级参考文献8

  • 1FCC. Spectrum Policy Task Force report of the spectrum efficiency working group, 02-155[R].2002.
  • 2CORDEIRO C, CHALLAPALI K, BIRRU D, et al. IEEE 802.22: the first worldwide wireless standard based on cognitive radios[C]//Proc of the 1st IEEE International Symposium on New Frontiers in Dynamic Spctrum Access Networks. 2005: 328-337.
  • 3DEBROY S, CHATTERJEE M. Intra-cell channel allocation scheme in IEEE 802.22 networks[C]//Proc of the 7th IEEE Consumer Communications and Networking Conference. 2010:1-6.
  • 4IEEE P802.22TM/D0.1, Draft standard for wireless regional area networks[S].2006.
  • 5SO Jung-min, VAIDYA N. Multi-channel MAC for Ad hoc networks:handling multi-channel hidden terminals using a single transceiver[C]//Proc of the 5th ACM International Symposium on Mobile Ad hoc Networksing and Computing. New York: ACM, 2004:222-233.
  • 6YU Ming-hao, HUANG Lian-fen, CHEN Hui-huang. Multi-channel MAC protocol for cognitive wireless mesh network[C]//Proc of the 2nd Anti-counterfeiting, Security and Identification. 2008:203-206.
  • 7YOO S, NAN H, HYON T I. DCR-MAC: distributed cognitive radio MAC protocol for wireless Ad hoc networks[J].Wireless Communications & Mobile Computing, 2009,9(5):631-653.
  • 8JHA S C, RASHID M M, BHARGAYA V K. OMC-MAC: an opportunistic multichannel MAC for cognitive radio networks[C]//Proc of the 70th Vehicular Technology Conference. 2009: 1-5.

共引文献5

同被引文献11

引证文献4

二级引证文献5

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部