期刊文献+

云计算模型在铁路大规模数据处理中的应用 被引量:22

Research on Cloud Computing and Its Application in Railway
下载PDF
导出
摘要 对铁路行业的计算资源、数据处理进行了特征分析.探讨了云计算模型中的虚拟化技术在铁路计算资源整合及MapReduce编程模型在大规模数据处理中的应用模式.采用Hadoop开源平台和Intel的虚拟化管理平台Tashi,提出和实现了基于云计算技术的铁路数据处理框架模型,并通过大规模的货票数据处理实例验证了框架模型的可扩展性和高效性. This paper analyzes the characteristics of the computing resources and data processing in China railway. Virtualization is utilized for railway resource integration and MapReduce programming model is utilized for railway large-scale data processing. Founding on Hadoop and a virtualization management platform Tashi, this paper proposes and implements a railway data processing framework. A freight invoice data processing application has verified the scalability and the high efficient may be seen in our effort.
出处 《北京交通大学学报》 CAS CSCD 北大核心 2010年第5期14-19,共6页 JOURNAL OF BEIJING JIAOTONG UNIVERSITY
基金 国家"863"计划项目资助(2006AA01Z207) 中央高校基本科研业务费专项资金资助(2009JBZ007-1) Intel中国研究院-北京交通大学联合研究课题(K09L00030)
关键词 云计算 虚拟化 MAPREDUCE 大规模数据处理 cloud computing virtualization MapReduce large-scale data processing
  • 相关文献

参考文献8

  • 1Michael Armbrust, Armando Fox. Above the Clouds: A Berkeley View of Cloud Computing[ E O/BL ]. (2009) ht tp: // www. EECS. berkeley, edu/Pubs/TechRpts/2009/ EECS-2009-28. pdf.
  • 2陈康,郑纬民.云计算:系统实例与研究现状[J].软件学报,2009,20(5):1337-1348. 被引量:1311
  • 3Jeffrey Dean, Sanjay Ghemawat. MapReduce: A Flexible Data Processing Tool[J].Communications of the ACM,2010,53(1): 72- 77.
  • 4Michael Stonebraker, Daniel Abadi, David J. DeWitt. MapReduce and Parallel DBMSs: Friends or Foes? [J]. Communications of the ACM, 2010, 53(1) : 64 - 71.
  • 5Pavlo A, Paulson E, Rasin A. A Comparison of Approaches To Large-Scale Data Analysis[ C]//Proceedings of the ACM SIGMOD International Conference. New York: ACM Press, 2009:165 - 178.
  • 6Nanda S, Chiueh T. A Survey of Virtualization Technologies[R]. Tech. Rep. 179. New York: Stony Brook University, 2005.
  • 7Kozueh M A, Ryan M P. Tashi: Location-Aware Cluster Management[C]//Proceedings of the ACM. Barcelona: ACDC, 2009:43 - 48.
  • 8Tom White. Hadoop: Definition Guide[ M]. U. S. A., O' REILLY, 2009:1 - 299.

二级参考文献29

  • 1Sims K. IBM introduces ready-to-use cloud computing collaboration services get clients started with cloud computing. 2007. http://www-03.ibm.com/press/us/en/pressrelease/22613.wss
  • 2Boss G, Malladi P, Quan D, Legregni L, Hall H. Cloud computing. IBM White Paper, 2007. http://download.boulder.ibm.com/ ibmdl/pub/software/dw/wes/hipods/Cloud_computing_wp_final_8Oct.pdf
  • 3Zhang YX, Zhou YZ. 4VP+: A novel meta OS approach for streaming programs in ubiquitous computing. In: Proc. of IEEE the 21st Int'l Conf. on Advanced Information Networking and Applications (AINA 2007). Los Alamitos: IEEE Computer Society, 2007. 394-403.
  • 4Zhang YX, Zhou YZ. Transparent Computing: A new paradigm for pervasive computing. In: Ma JH, Jin H, Yang LT, Tsai JJP, eds. Proc. of the 3rd Int'l Conf. on Ubiquitous Intelligence and Computing (UIC 2006). Berlin, Heidelberg: Springer-Verlag, 2006. 1-11.
  • 5Barroso LA, Dean J, Holzle U. Web search for a planet: The Google cluster architecture. IEEE Micro, 2003,23(2):22-28.
  • 6Brin S, Page L. The anatomy of a large-scale hypertextual Web search engine. Computer Networks, 1998,30(1-7): 107-117.
  • 7Ghemawat S, Gobioff H, Leung ST. The Google file system. In: Proc. of the 19th ACM Symp. on Operating Systems Principles. New York: ACM Press, 2003.29-43.
  • 8Dean J, Ghemawat S. MapReduce: Simplified data processing on large clusters. In: Proc. of the 6th Symp. on Operating System Design and Implementation. Berkeley: USENIX Association, 2004. 137-150.
  • 9Burrows M. The chubby lock service for loosely-coupled distributed systems. In: Proc. of the 7th USENIX Symp. on Operating Systems Design and Implementation. Berkeley: USENIX Association, 2006. 335-350.
  • 10Chang F, Dean J, Ghemawat S, Hsieh WC, Wallach DA, Burrows M, Chandra T, Fikes A, Gruber RE. Bigtable: A distributed storage system for structured data. In: Proc. of the 7th USENIX Symp. on Operating Systems Design and Implementation. Berkeley: USENIX Association, 2006. 205-218.

共引文献1310

同被引文献151

引证文献22

二级引证文献143

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部