期刊文献+

A prediction mechanism of file access popularity and optimal strategy of replicas deployment in cloud computing

A prediction mechanism of file access popularity and optimal strategy of replicas deployment in cloud computing
下载PDF
导出
摘要 In cloud computing,the number of replicas and deployment strategy have extensive impacts on user's requirement and storage efficiency.Therefore,in this paper,a new definition of file access popularity according to users' preferences,and its prediction algorithm are provided to predict file access trend with historical data.Files are sorted by priority depending on their popularity.A mathematical model between file access popularity and the number of replicas is built so that the reliability is increased efficiently.Most importantly,we present an optimal strategy of dynamic replicas deployment based on the file access popularity strategy with the overall concern of nodes' performance and load condition.By this strategy,files with high priority will be deployed on nodes with better performance therefore higher quality of service is guaranteed.The strategy is realized in the Hadoop platform.Performance is compared with that of default strategy in Hadoop and CDRM strategy.The result shows that the proposed strategy can not only maintain the system load balance,but also supply better service performance,which is consistent with the theoretical analysis. In cloud computing, the number of replicas and deployment strategy have extensive impacts on user's requirement and storage efficiency. Therefore, in this paper, a new definition of file access popularity according to users' preferences, and its prediction algorithm are provided to predict file access trend with historical data. Files are sorted by priority depending on their popularity. A math- ematical model between file access popularity and the number of replicas is built so that the reliabili- ty is increased efficiently. Most importantly, we present an optimal strategy of dynamic replicas de- ployment based on the file access popularity strategy with the overall concern of nodes' performance and load condition. By this strategy, files with high priority will be deployed on nodes with better performance therefore higher quality of service is guaranteed. The strategy is realized in the Hadoop platform. Performance is compared with that of default strategy in Hadoop and CDRM strategy. The result shows that the proposed strategy can not only maintain the system load balance, but also sup- ply better service performance, which is consistent with the theoretical analysis.
出处 《High Technology Letters》 EI CAS 2015年第1期63-70,共8页 高技术通讯(英文版)
基金 Supported by the National Natural Science Foundation of China(No.61170209,61272508,61202432,61370132,61370092)
关键词 文件访问 部署策略 预测算法 最优策略 副本 计算 服务性能 机制 cloud computing, Hadoop, file access popularity, load balance, quality of service
  • 相关文献

参考文献4

二级参考文献86

  • 1宁焕生,张瑜,刘芳丽,刘文明,渠慎丰.中国物联网信息服务系统研究[J].电子学报,2006,34(B12):2514-2517. 被引量:151
  • 2Sanjay Ghernawat, Howard Gobioff, Shun-Tak Leung. The Google file system E A] .Proc of the 19th ACM Symposium on Operating Systems Principles [C]. New York: ACM Press, 2003.29 - 43.
  • 3Dhruba Borthaku. The Hadoop Distributed File System: Architecture and Design E EB/OL 1. http://hadoop, apache, org/ common/docs/r0.16.0/hdfs_ design, pdf, 2011.
  • 4Hbase Development Team. Hbase: Bigtable-Like Slructured Storage for Hadoop Hdfs [ EB/OL ]. http://wiki, apache. org/hadoop/Hbase, 2011.
  • 5Amazon. Amazon Simple Storage Service[EB/OL]. http:// www. amazon, com/s3,2011.
  • 6Yunhong Gu, Robert L Grossman. Sector and sphere: The design and implementation of a high-performance data cloud ~ J]. Philosophical Transactions of the Royal Society, 2009, 367A: 2429 - 2445.
  • 7Robert L Grossman, Yunhong Gu.Data mining using high per- formance data clouds: Experimental studies using sector and sphere [ A ]. Proc of the 14th ACM SIGKDD [ C ]. Las Vegas: ACM Press, 2008.920 - 927.
  • 8James Bmberg,Rajkumar Buyya,Zahir Taft. Creating a 'cloud storage' mashup for high performance, low cost content delivery [A]. Proc of the 6th International Conference on Service- Oriented Computing [ C ]. ICSOC 2008, Australia, Springer, LNCS 5472,2009. 178- 183.
  • 9James Broberg, Zahir Taft. MetaCDN: Harnessing storage clouds for high performance content delivery [A]. Proc of the 6th International Conference on Service-Oriented Computing [C], ICSOC 2008, Australia, Springer, LNCS 5364,2008.730 - 731.
  • 10Kevin D Bowers, Ari Juels, Alina Oprea. HAIL: A High- Availability and Integrity Layer for Cloud Storage I EB/ OL ]. http: / / eprint, iacr. org/, 2011.

共引文献295

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部