期刊文献+

基于热点访问的分布式数据库HBase负载均衡算法研究 被引量:3

Research on Load Balancing Algorithm of Distributed Database HBase Based on Hotspot Access
下载PDF
导出
摘要 为了规避数据库集群中部分节点过载风险,提升分布式数据库的可靠性,分析了HBase数据库的数据格式及总体架构。通过综合对比各类实现方法,选择成本低易实现的软件算法实现负载均衡。针对原有负载策略的缺陷设计了基于热点访问的改进算法,综合考虑region迁移成本、region本地化成本与集群负载情况后选择迁移策略。在VMware搭建环境,利用shell读写数据进行分析,验证结果表明改进算法无论在region count还是request方面均衡效果均更佳,为HBase分布式数据库的负载均衡策略提供了可参考方案。 In order to avoid the overload risk of some nodes in the database cluster,and improve the reliability of the distributed database,the data format and overall architecture of the HBase database are analyzed.Through comprehensive comparison of various implementation methods,the software algorithm with low cost and easy implementation is selected to achieve load balancing.Aiming at the defects of the original load strategy,an improved algorithm based on hot spot access is designed,and the migration strategy is selected after considering the migration cost of region,localization cost of region and cluster load situation.An environment is built in VMware,and the shell is used to read and write data for analysis.The verification results show that the improved algorithm has better balancing effect in both region count and request,which provides a reference scheme for load balancing strategy of HBase distributed database.
作者 李峻屹 LI Junyi(Department of Information Technology,Shaanxi Police College,Xi’an 710021,China)
出处 《微型电脑应用》 2022年第5期138-141,共4页 Microcomputer Applications
关键词 分布式数据库 HBASE 负载均衡 热点访问 迁移Cost算法 distributed database HBase load balancing hotspot access migration Cost algorithm
  • 相关文献

参考文献14

二级参考文献58

  • 1刘汪根,郑淮城,荣国平.云环境下大规模分布式计算数据感知的调度系统[J].大数据,2020,6(1):81-98. 被引量:10
  • 2E Jeannot, E Sanle, D Trystram. Bi -Objective approximation scheme for makespan and reliability optimization on uniform paral- lel machines[ C]. Proceedings of International Euro- Par Confer- ence on Parallel and Distributed Computing ( Euro - Par). Las Palmas de Gran Canaria, Spain, Aug 2008.
  • 3E Jeannot, E Sanle, D Trystram. Optimizing performance and reli- ability on heterogeneous parallel systems : approximation algorithms and heuristics[J]. Journal of Parallel and Distributed Computing (JPDC) , 2012,72 ( 2 ) :268 - 280.
  • 4G Aupy, A Benoit, Y Robert. Energy - aware scheduling under reliability and makespan constraints[ R]. ENS DE LYON, France (Ecole Normale Sup6rieure de Lyon) , 2011.
  • 5E Thereska, A Donnelly, D Narayanan. Sierra: Practical Power- proportionality for Data Center Storage [ C ]. In : Proc. of EuroSys, Salzburg, Austria : ACM, April 2011 : 169 - 182.
  • 6L Z Wang, S U Khan, J Dayal. Thermal aware workload placement with task -temperature profiles in a data center[ J]. Journal of Su- percomputing 2011,61 ( 3 ) : 780 - 803.
  • 7L Z Wang, S U Khan. Review of performance metrics for green da- ta centers: a taxonomy study [ J ]. Journal of Supercomputing March 2013,63 ( 3 ) :639 - 656.
  • 8C Jing, Y Z Zhu, M L Li. SEED: solar energy- aware efficient scheduling for data centers [ J ]. Concurrency and Computation: Practice and Experience 2014,26 ( 18 ) : 2811 - 2835.
  • 9X Wang, Y Yao, X Wang, K Lu, Q Cao. CARPO: Correlation - Aware Power Optimization in Data Center Networks [ C ]. In: Proe. IEEE International Conference on Computer Communications (INFOCOM). Orlando, FL, USA, 2012.
  • 10O Kallenberg. Foundations of Modern Probability [ M ]. USA: Springer, 2002.

共引文献104

同被引文献44

引证文献3

二级引证文献1

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部