摘要
针对目前校园海量数据存储面临的服务器资源利用率低、管理维护成本高等问题,在云存储技术的基础上提出了校园云存储服务的设计,并进行了实验.为减少读写速率的损失,系统通过调用HDFS(Hadoop distributed filesystem)的API接口方式实现数据存储及对集群的状态监控和管理.实验表明:传输文件的大小和集群中数据节点的个数对云存储服务的数据读写速率的影响较大;HDFS并行传输大量小文件的速率相对较低.
Concerning the existing problems such as the low utilization and high costs for operation of the massive data storage on campus, a cloud storage service for campus was designed based on the cloud storage technology, and an expriment was carried out about that. To achieve higher I/O efficiency, the system can implement data storage, and also monitor and manage cluster status by using HDFS (Hadoop distributed file system) API. Experimental results of the system performance show that the size of the files being transferred and the number of the cluster data nodes have great influence on the reading and writing speed of the cloud storage service, while the parallel transmitting rate of small files on HDFS is relatively low.
出处
《天津科技大学学报》
CAS
2012年第5期69-73,共5页
Journal of Tianjin University of Science & Technology
基金
天津市高等学校科技发展基金计划项目(20100823)
天津市科技型中小企业创新资金项目(11ZXCXGX07700)