期刊文献+

结合区块链的非结构化大数据云存储优化研究 被引量:7

Research on Cloud Storage Optimization of Unstructured Big Data Combined with Blockchain
下载PDF
导出
摘要 针对非结构化数据云存储效率低下的问题,提出了结合区块链技术的非结构化大数据云存储方法。云存储网络利用F2域获得存储信息,根据域首判断出数据状况,实时更新存储策略;同时存储调度利用存储窗与采集窗估算出数据均值与动态振荡,确定存储更新的频次。另外,在云存储网络中引入存储审计策略,根据数据热度与损坏性确定存储审计需求,对存储数据进行存储时间、数据包量的审计,从而优化存储效率。最后考虑到传统非结构化数据云存储过程中的数据验证效率不佳问题,设计了区块链网络结构,并在其中实现了基于Merkle树与Hash的数据完整性高效验证。仿真结果表明,结合区块链技术的非结构化大数据云存储方法显著降低了数据的审计与存储时间,有效提高了非结构化数据的云存储效率,具有良好的大数据处理性能。 Aiming at the low efficiency of unstructured data cloud storage, a cloud storage method of unstructured big data combined with blockchain technology is proposed. Cloud storage network uses F2 domain to obtain storage information, judges data status according to domain head, and updates storage strategy in real time;At the same time, the storage scheduling uses the storage window and acquisition window to estimate the data mean value and dynamic oscillation, and determines the storage update frequency. In addition, the storage audit strategy is introduced into the cloud storage network to determine the storage audit requirements according to the data heat and damage, Audit the storage time and packet quantity of stored data to optimize the storage efficiency. Finally, considering the low efficiency of data validation in traditional unstructured data cloud storage process, a blockchain network structure is designed, The data integrity verification based on Merkle tree and hash is implemented. The simulation results show that the unstructured big data cloud storage method combined with blockchain technology significantly reduces the data audit and storage time, effectively improves the cloud storage efficiency of unstructured data, and has good big data processing performance.
作者 徐智 王岳 王欣 XU Zhi;WANG Yue;WANG Xin(School of Mechanical and Electrical Engineering,Sanjiang University,Nanjing Jiangsu 210012,China;School of Naval Architecture and Ocean Engineering,Jiangsu University of Science and Technology,Zhenjiang Jiangsu 12003,China)
出处 《计算机仿真》 北大核心 2021年第7期304-307,354,共5页 Computer Simulation
基金 江苏省高校自然科学研究项目(15KJD510006)。
关键词 区块链 非结构化大数据 完整性审计 哈希算法 云存储 Blockchain Unstructured big data Integrity audit Hash algorithm Cloud storage
  • 相关文献

参考文献6

二级参考文献86

  • 1SAKR S, LIU A, BATISTA D M, et al. A survey of large scale data management approaches in cloud environments [ J]. IEEE Communications Surveys and Tutorials, 2011, 13(3): 311 -336.
  • 2THUSOO A, SHAO Z, ANTHONY S, et al. Data warehousing and analytics infrastructure at Facebook [ C]//SIGMOD 2010: Proceedings of the 2010 ACM International Conference on Management of Data. New York: ACM, 2010: 1013- 1020.
  • 3Fermi National Accelerator Laboratory. The Dθ experiment [ EB/ OL]. [ 2015-06-10]. http://www-d0.fnal.gov/.
  • 4TERZIEVA V, KADEMOVA P, TODOROVA K. Big data -- an essential requisite of future education [ C]// BdKCSE 2014: Proceedings of the I st IICT International Conference on Big Data, Knowledge and Control Systems Engineer. Bulgaria: Bulgarian Academy of Sciences, Institute of Information and Communication Technologies, 2014:83-95.
  • 5GANTZ J, REINSEL D. The digital universe in 2020: big data, bigger digital shadows, biggest growth in the far east [ C/OL]. IDC iView: IDC Analyze the FutureIDC, 2012 [2015-05-20]. http://www.emc.com/collateral/analystreports/idc-the-digital -universe-in-2020. pdf.
  • 6POKOMY J. NoSQL databases: a step to database scalability in Web environment [ J]. International Journal of Web Information Systems, 2013, 9(1) : 278 -283.
  • 7DEKA G C. A survey of cloud database systems [ J]. IT Professional, 2014, 16(2): 50-57.
  • 8FAY C, JEFFREY D, SANJAY G, et al. Bigtable: a distributed storage system for structured data [ J]. ACM Transactions on Computer Systems, 2008, 26(2): Article No. 4.
  • 9DECANDIA G, HASTORUN D, JAMPANI M, et al. Dynamo: Amazon's highly available key-value store [ C]//SOSP 2007: Proceedings of 21th ACM SIGOPS Symposium on Operating Systems Principles. New York: ACM, 2007:205-220.
  • 10LAKSHMAN A, MALIK P. Cassandra: structured storage system on a P2P network [ C]// Proceedings of the 28th ACM Symposium on Principles of Distributed Computing. New York: ACM Press, 2009: 5.

共引文献68

同被引文献82

引证文献7

二级引证文献24

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部