摘要
Hadoop技术的两大核心框架设计是HDFS(Hadoop Distribution File System)和MapReduce。HDFS为Hadoop分布式文件存储系统,MapReduce为分布式计算模型。本文以实训室现运行物联网资产管理系统采集并存储的大数据为基础,利用实训室淘汰的老旧计算机搭建成Hadoop完全分布式集群系统,将物联网系统和大数据Hadoop集群系统加以融合创新,对数据进行格式化处理后在真实集群系统平台中进行测试分析。经验证,Hadoop大数据技术架构下的物联网资产管理系统可以高效地管理数据。
The two core framework designs of Hadoop technology are HDFS(Hadoop Distribution File System)and MapReduce.HDFS is a Hadoop distributed file storage system,and MapReduce is a distributed computing model.In this paper,based on the big data collected and stored by the current running IoT asset management system in the training room,the old computers eliminated from the training room was used to build a Hadoop fully distributed cluster system,the Internet of Things system and the big data Hadoop cluster system were integrated and innovated,after formatting the data,it was tested and analyzed in the real cluster system platform.It has been verified that the IoT asset management system under the Hadoop big data technology framework can efficiently manage data.
作者
周少珂
张振平
邵华
徐茹茹
张瑛
ZHOU Shaoke;ZHANG Zhenping;SHAO Hua;XU Ruru;ZHANG Ying(Information Engineering School,Henan Technical Institute,Zhengzhou Henan 450042)
出处
《河南科技》
2021年第12期22-25,共4页
Henan Science and Technology
基金
河南省科技厅科技攻关项目(212102210430)
2019年河南省高等教育教学改革研究与实践项目“基于类型教育的‘四跨界四融合’人才培养模式的探索与实践”(2019SJGLX677)
河南省教育厅教育科学、就业创业类研究项目(2020YB0499)
校级科研项目(2019B-KJ-17)
河南应用技术职业学院2018校级教学改革立项建设青年项目“智慧教室环境下的教学方式研究”。