期刊文献+

云平台下的装备保障管理系统结构化数据查询 被引量:2

Structured Data Query in the Equipment Support Management System Based on Cloud Platform
下载PDF
导出
摘要 首先针对我军装备保障管理系统关系数据库在海量数据查询以及分析处理方面的不足,在对系统数据资源分析的基础上提出并实现了基于Hadoop云平台结构化数据查询策略,通过Sqoop工具将数据库中的数据导入到HDFS中,并利用Hive进行数据分析.然后通过实验证明此方法克服了海量数据在单机环境中查询效率低下的缺点,具有较高的实用价值. First, this paper talked about the deficiencies of current Equipment Support Management System on massive data query and analysis. Then it proposed and realized a method of Structured Data Query used by the Cloud Platform based on Hadoop, after analyzing the data source. In the article, we used the tool of Sqoop to import data from a relational database into HDFS, and then use Hive to analyze the data. Finally, the experiment proved that the method makes up the shortage of the data query in the environment of single computer, and has high practical value.
出处 《计算机系统应用》 2015年第2期70-74,共5页 Computer Systems & Applications
关键词 数据资源 HADOOP 云平台 Sqoop Hive structured data Hadoop cloud platform Sqoop Hive
  • 相关文献

参考文献6

  • 1Shvachko K, Kuang H, Radia S, Chansler R. The hadoop distributed file system. Sunnyvale. California USA. IEEE, 2010: 1-10.
  • 2Ashish T, Joydeep S, Namit J, et al. Hive-A petabyte scale data warehouse using hadoop. IEEE 26th International Comference on Data Engineering(ICDE). 2010. 996-1005.
  • 3Apache Sqoop. Sqoop. http://sqoop, apache.org. [2012-03].
  • 4程相,孙继银,李琳琳,梅生,唐中奇.基于RDF的军事网格资源描述方法研究[J].计算机技术与发展,2011,21(10):129-132. 被引量:7
  • 5苏天醒等.基于RDF的资源描述与共享方法的研究.应用与安全,2010,(9):36-38.
  • 6刘永增,张晓景,李先毅.基于Hadoop/Hive的web日志分析系统的设计[J].广西大学学报(自然科学版),2011,36(A01):314-317. 被引量:24

二级参考文献13

  • 1李菊芳,贺仁杰,姚峰.卫星观测任务数据的XML描述[J].计算机工程与应用,2004,40(32):209-211. 被引量:6
  • 2朱莹,吴军华,汪婷婷,刘一田.网格资源描述技术的比较研究[J].微计算机信息,2006,22(04X):176-178. 被引量:8
  • 3Foster I. What is grid? A Three Point Checklist[ EB/OL]. 2002. http ://www-fp. mes. anl. gov/-foster/ Articles/What Is The Grid. pdf. 2002.
  • 4Manola F, Miller E. RDF Primer [ EB/OL ]. 2004- 02. ht- tp ://www. w3. org/TR./rdf-primer.
  • 5Florescu D, Kossman D. Storing and Querying XML Data U- sing a RDBMS[ J]. IEEE Data Engineering Bulletin, 1999, 22 (3) :27-34.
  • 6RDF Vocabulary Description language 1.0 : RDFSchema [ EB/OL]. 2004-02. http ://www. w3. org/TR/rdf-schema.
  • 7HUSSAIN T, ASGHAR S, MASOOD N. Web Usage Mining:A Survey on Preprocessing of Web Log File[ C]//Information and Emerging Technologies, 2010 : 1-6.
  • 8ASHISH T, JOYDEEP S, NAMIT J, et al. Hive-A Petabyte Scale Data Warehouse Using Hadoop[ C ],//Data Engineering (ICDE), 2010 IEEE 26th International :996-1005.
  • 9Tom White.Hadoop权威指南[M].曾大聃,周傲英,译.北京:清华大学出版社,2010.
  • 10HE YONGQIANG, LEE RUBAO, HUAI YIN, et al. RCFile:A Fast and Space-efficient Data Placement Structure in MapReduce-bsed Warehouse Systems[ C ]//Data Engineering (ICDE), 2010 IEEE 26th International :996-1005.

共引文献29

同被引文献5

引证文献2

二级引证文献6

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部