期刊文献+

基于弹性搜索的异构多表联查方法 被引量:1

Heterogeneous multi-table joint search method based on elastic search
下载PDF
导出
摘要 弹性搜索技术作为性能优越的海量数据检索技术被广泛应用到各类数据分析场景中,文中提出一种基于弹性搜索的多表联查方法,在弹性搜索技术基础上面向交互式分析需求,利用采样、散列相结合的思路实现海量异构多表的秒级联查。实验表明,在海量数据的背景下,该算法的查询效率明显优于现有的基于弹性搜索的多表联查技术。 As a massive data retrieval technology with superior performance,elastic search technology is widely used in various data analysis scenarios.A multi-table joint search method based on elastic search is proposed in this paper,which faces interactive analysis needs based on elastic search technology.The idea of combining sampling and hashing is used to realize the second cascade check of massive heterogeneous multi-meters.Experiments show that in the context of massive data,the query efficiency of this algorithm is significantly better than the existing multi-table joint query technology based on elastic search.
作者 张腾 李常宝 李晓辉 刘忠麟 ZHANG Teng;LI Chang-bao;LI Xiao-hui;LIU Zhong-lin(North China Institute of Computing Technology,Beijing 100191,China)
出处 《信息技术》 2020年第12期148-151,157,共5页 Information Technology
关键词 弹性搜索 多表联查 Hash采样 elastic search multi-table joint search Hash sampling
  • 相关文献

参考文献3

二级参考文献17

  • 1WHITE T.Hadoop:the definitive guide[M].3rd ed.Beijing:O'Reilly Media,2013.
  • 2DEAN J,GHEMAWAT S.MapReduce:simplified data processing on large clusters[J].Communications of the ACM:50th Anniversary Issue,2008,51(1):107-113.
  • 3VARDI M.The complexity of relational query languages[C]// Proceedings of the fourteenth annual ACM symposium on Theory of computing.USA:ACM,1982:137-146.
  • 4THUSOO A,SARMA J S,JAIN N,et al.Hive:a warehousing solution over a map-reduce framework[J].Proceedings of the VLDB Endowment,2009,2(2):1626-1629.
  • 5ZAHAKIA M,CHOWDHURY M,DAS T,et al.Resilient dis- tributed datasets:A fault - tolerant abstraction for in - memory cluster computing[C]// Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation.[S.l.]:USENIX Association,2012:2-12.
  • 6YANG H,DASDAN A,HSIAO R L,et al.Map - reduce -merge:simplified relational data processing on large clusters[C]// Proceedings of the ACM SIGMOD International Conference on Management of Data.New York:ACM,2007;1029-1040.
  • 7LUO Yi,WANG Wei,LIN Xuemin.Spark:A keyword search engine on relational databases[C]// Proceedings of 2013 IEEE 29th International Conference on Data Engineering(ICDE).[S.l.]:IEEE,2008:1111-1118.
  • 8CYGANIAK R.A relational algebra for SPARQL,HPL -2005-170[D].Bristol:Digital Media Systems Laboratory,2005.
  • 9覃雄派,王会举,杜小勇,王珊.大数据分析——RDBMS与MapReduce的竞争与共生[J].软件学报,2012,23(1):32-45. 被引量:386
  • 10亓开元,赵卓峰,房俊,马强.针对高速数据流的大规模数据实时处理方法[J].计算机学报,2012,35(3):477-490. 被引量:95

共引文献346

同被引文献9

引证文献1

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部