期刊文献+

一种有效的并行数据库动态负载平衡连接算法 被引量:3

Efficient dynamic workload balancing join algorithm in parallel database
下载PDF
导出
摘要 在基于Shared-nothing结构的并行数据库中,负载平衡一直是影响查询处理性能的重要因素。在数据库中频繁使用的连接操作会因为各种因素导致的负载倾斜和额外的通讯开销而降低数据库的整体性能。提出了一种基于RCMD分布方法的动态负载平衡连接算法,能够在连接操作的执行过程中动态调整各个结点的负载。理论分析和实验结果证明提出的算法能够有效地平衡负载,提高并行数据库的执行效率。 Workload balance has great influence on the query processing performance in shared-nothing parallel database system. The process of join operator that is often used in parallel database would bring the extra communication costs and incur Workload skew problem among the nodes.In this paper,we propose an effective join algorithm based on RCMD data distribution method that can balance the workload smoothly during the process of join queries.Theoretical analysis and experimental results show that this algorithm improves the performance of parallel database efficiently.
出处 《计算机工程与应用》 CSCD 北大核心 2007年第12期150-154,共5页 Computer Engineering and Applications
关键词 并行数据库 动态负载平衡 RCMD 连接 parallel database dynamic workload balancing RCMD ,join
  • 相关文献

参考文献10

  • 1Walton C B,Dale A G,Jenevein R M.A taxonomy and performance model of data skew effects in parallel joins[C]//Procs 17th Intl Conf on VLDB,1991:537-548.
  • 2Erhard Rahm,Robert Marek.Analysis of dynamic load balancing strategies for parallel shared nothing database systems[C]//Proc 19th VLDB Conf,1993:182-193.
  • 3Erhard Rahm.Dynamic load balancing in parallel database systems[C]//LNCS:Proc Euro-PAR 96 Conf.,Lyon:Springer-Verlag,1996.
  • 4Lilian Harada,Fujit su Labs,Dynamic join product skew hanldling for hash-joins in shared-not hing database systems[C]//Proceedings on DASFAA'95,Singapore,April,1995:10-13.
  • 5Lerner A.An architecture for handling load balanced parallel joins in shared nothing systems[D].PUCRio Department de Informatica,1998.
  • 6Lerner A,Lifschitz S.Towards a taxonomy for load banlancing techniques on shared-nothing parallel join algorithms[R].Technical report,Pontificia Universisdade Catolica do Rio de Janeiro,Computer Science Department,MCC,1998(28).
  • 7Lerner A,Lifschitz S.A study of workload balancing techniques on parallel join algorithms[C]//Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications(PDPTA),Las Vegas,EUA,July,1998:966-973.
  • 8艾春宇,李建中,高宏.一种有效的并行数据库数据分布方法RCMD[J].计算机科学,2005,32(11):108-111. 被引量:2
  • 9Li Jianzhong,Srivastava J,Rotem D.CMD:A multi-dimensional declustering method for parallel database systems[C]//Yuan Liyan ed.Proceedings of VLDB '92,VanCouver,1992.San Mateo:Morgan kaufmann Publishers,Inc,1992:3-14.
  • 10李建中,都薇.并行数据库上的并行CMD-Join算法[J].软件学报,1998,9(4):256-262. 被引量:5

二级参考文献10

  • 1李建中.并行数据操作算法和查询优化技术[J].软件学报,1994,5(10):11-23. 被引量:36
  • 2李建中.并行数据库的查询处理并行化技术和物理设计方法[J].软件学报,1994,5(10):1-10. 被引量:32
  • 3李建中,Proceedings of the 18th International Conference on Very Large Data Bases Conference,1992年
  • 4李建中,J Comput Sci Technol,1992年,7卷,4期,316页
  • 5Hua K A,Proceedings of the of the International Conference on Very Large Data Bases’91,1991年,525页
  • 6Teradata Corporation. DBC/1012 Data Base Computer Concepts and Facilities. Teradata Document C02-001-05, Los Angeles, Calif, 1998.
  • 7Kitsuregawa M, Tanaks H, Moto-Oka T. Architecture and Performance of Relational Algebra Machine GRACE. In: Proc. of the Intl. Conf. on Parallel Processing, Chicago, 1984.
  • 8DeWitt D J, et al. GAMMA: A High Performance Dataflow Database Machine. In:Proc. of Inter. Conf. on VLDB, 1986. 228-237.
  • 9Li Jianzhong, Srivastava J, Rotem D. CMD: A Multidimensional Declustering Method for Parallel Database Systems. In: Proc. of the 18th VLDB Conf. Vancouver, British Columbia, Canada,1992.
  • 10艾春宇 李建中 高宏.自适应的并行关系存储方式选择算法及在线转换技术[A]..NDBC[C].长沙,2003..

共引文献5

同被引文献17

  • 1P.Scheuermann,G.Weikum,P Zabback. Data Partitioning and Load Balancing in Parallel Disk Systems[J]. VLDB Journal,1998,7(1).
  • 2C.Baru.DB2 Parallel Edition Database Systems :The future of high performance database systems.[J].IBM Systems Journal,1995,34(2).
  • 3David J.DeWitt,Jim Gray.Parallel Database systems:The Future of High Perforglance Database Processing [J].Comm. of the ACM,ACM Press,1992:85-98.
  • 4维克托·迈尔-舍恩伯格,肯尼思·库克耶.大数据时代[M].杭州:浙江人民出版社,2013:5-25.
  • 5潘志安.并行数据库的查询处理技术[J]科技信息(学术版),2006(06).
  • 6孟小峰.云数据管理与Nosql运动[J].中国计算机学会通讯,2011(7).
  • 7潘志安.并行数据库的查询处理技术[J].科技信息(学术版),2006(6).
  • 8柳锴,唐雨新,张云泉,李玉成.基于机群架构的并行数据库实现技术研究[J].计算机工程与设计,2008,29(3):526-529. 被引量:6
  • 9鱼佳欣,师军,卢照.无共享并行数据库中的数据分布研究[J].计算机与数字工程,2010,38(3):54-56. 被引量:2
  • 10王珊,王会举,覃雄派,周烜.架构大数据:挑战、现状与展望[J].计算机学报,2011,34(10):1741-1752. 被引量:615

引证文献3

二级引证文献6

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部