期刊文献+

基于Hadoop平台的电信大数据入库及查询性能优化研究 被引量:9

下载PDF
导出
摘要 随着移动互联网的快速发展,电信运营商内部各种IT系统中的数据出现了"大数据"的特征,既有的技术架构和路线已无法高效处理如此海量的数据。针对流量经营大数据管理和大数据服务中海量DPI数据的数据入库和数据查询场景,提出了一种基于Hadoop的分布式数据服务架构,并设计出在该架构下的数据入库和查询性能的优化算法,通过模拟数据的实验对性能优化算法进行了验证。
出处 《移动通信》 2014年第7期58-63,共6页 Mobile Communications
  • 相关文献

参考文献8

  • 1蔡斌,陈湘萍.Hadoop技术内幕:深入解析Hadoop Common和HDFS架构设计与实现原理[M].北京:机械工业出版社,2013.
  • 2Lars George. HBase: The Definitive Guide[M]. O'Reilly, 2012.
  • 3陈能技,郭柏雅,性能测试诊断分折与优化[M].北京:电子工业出版社,2012.
  • 4Apache. HUG8: January HBase User Group at StumbleUpon[EB/OL]. (2010-07-27). http://www. meetup.com/hbaseusergroup/events/12241393/.
  • 5Apache. The Apache HBaseTM Reference Guide[EB/ OL]. (2013-06-11). http://hbase.apache.org/book. html#configuration.
  • 6林伟伟.一种改进的Hadoop数据放置策略[J].华南理工大学学报(自然科学版),2012,40(1):152-158. 被引量:35
  • 7张榆,马友忠,孟小峰.一种基于HBase的高效空间关键字查询策略[J].小型微型计算机系统,2012,33(10):2141-2146. 被引量:33
  • 8European Conference, ServiceWave 2011 4th. Enhancing Query Support in HBase via an Extended Coprocessors Framework[C]. 2011.

二级参考文献21

  • 1Rajkumar Buyya,Chee Shin Yeo,Srikumar Venugopal,et al.Cloud computing and emerging IT platforms:vision,hype,and reality for delivering computing as the 5 th utility[J].Future Generation Computer Systems,2009,25 (6):599-616.
  • 2Dean J,Ghemawat S.MapReduce:simplified data processing on large clusters[J].Communications of the ACM,2008,51 (1):107-113.
  • 3Borthakur D.Hadoop[EB/OL].[2011-06-15].http://lucene.apache.org/hadoop.
  • 4Ghemawat S,Gogioff H,Leung P T.The google file system[C] //Proc of the 19 th ACM Symp on Operating Systems Principles.New York:ACM,2003:29-43.
  • 5John Dorion.Applications powered by Hadoop[EB/OL].[2011-06-15].http://wiki.apache.org/hadoop/PoweredBy.
  • 6Amazon.Amazon elastic compute cloud[EB/OL].[2011-06-15].http://aws.amazon.com/ec2.
  • 7Borthakur D.The hadoop distributed file system:architecture and design[EB/OL].[2011-06-15].http://hadoop.apache.org/hdfs/docs/current/hdfs _ design.html.
  • 8Zaharia M,Konwinski A,Joseph A D.Improving mapreduce performance in heterogeneous environments[C] //Proc of the 8th Usenix Symp on Operating Systems Design and Implementation.New York:ACM Press,2008:29-42.
  • 9Xie Jiong,Yin Shu,Ruan Xiao-jun,et al.Improving mapreduce performance through data placement in heterogeneous hadoop clusters[C] //IPDPS Workshops.Atlanta:IEEE Computer Society Press,2010:1-9.
  • 10HBase :bigtable-like structured storage for hadoop hdfs [ EB/OL ]. http ://hadoop. apache, org/hbase/,2010.

共引文献67

同被引文献78

引证文献9

二级引证文献43

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部