期刊文献+

存储最优的连续MAX查询方法

Optimal storage method for continuous MAX query
下载PDF
导出
摘要 考虑滑动窗口数据流上的连续MAX查询问题,提出了一种存储最优的方法。该方法只需保存数据集中可能成为极大值点的部分数据(候选点集),而将所有完全不可能成为极值点的数据进行丢弃,从而可以有效降低存储开销;提出了一个动态维护候选点集的方法,当数据独立分布时,处理一个新到数据所需的时间为(log),处理数据失效的时间开销为1,其中为滑动窗口包含的全部数据数目。理论分析和实验结果表明了该方法能够适应流速很快的场景,具有较高的效率。 The problem of continuous MAX query over sliding window data streams is addressed, and an optimal storage method is proposed. Only some of data points (candidate points) need to be stored in the system, while others is discarded with correctness guarantee. An effective method is designed to maintain the candidate points set dynamically. When the data satisfies random dis- tribution, only O (log N) time is needed to process a new arriving data point, while removal of an expired point is handled in O(1) time, where Nis the number of points contained in the sliding window. Theoretical analysis and experimental result show the efficiency of proposed method.
作者 汤新鸿
出处 《计算机工程与设计》 CSCD 北大核心 2008年第7期1863-1864,1868,共3页 Computer Engineering and Design
关键词 数据流 连续极大值查询 滑动窗口 数据裁减 存储最优 data stream continuous max query sliding window data pruning optimal storage
  • 相关文献

参考文献8

  • 1金澈清,钱卫宁,周傲英.流数据分析与管理综述[J].软件学报,2004,15(8):1172-1181. 被引量:161
  • 2Babcock B.Models and issues in data stream systems[C].PODS.Madison:ACM Press,2002:1-16.
  • 3Widom J.STREAM project[EB/OL].http://www-db.stanford.edu/stream/,2007.
  • 4Michael J Franklin.Telegraphcq:continuous dataflow processing for an uncertain world[C].CIDR.Asilomar:Morgan Kauf.man Publishers,2003:269-280.
  • 5Cherniack M.Aurora project[EB/OL].www.cs.brown.edu/research/aurora/,2007.
  • 6Arasu A.Widom J.Resource sharing in continuous sliding-window aggregates[C].VLDB.Toronto:Morgan Kaufmann.2004:336-347.
  • 7于亚新,朱歆华,于戈.数据流滑动窗口上的一种多聚集查询共享策略[J].东北大学学报(自然科学版),2005,26(11):1048-1051. 被引量:3
  • 8L.mX,Yuan Y,Wang w,et al.Stabbing the sky:efficient skyline computation over sliding windows[C].Tokyo,Japan:ICDE,2005:502-513

二级参考文献61

  • 1Babcock B, Babu S, Datar M, Motwani R, Widom J. Models and issues in data streams. In: Popa L, ed. Proc. of the 21st ACM SIGACT-SIGMOD-SIGART Symp. on Principles of Database Systems. Madison: ACM Press, 2002. 1~16.
  • 2Terry D, Goldberg D, Nichols D, Oki B. Continuous queries over append-only databases. SIGMOD Record, 1992,21(2):321-330.
  • 3Avnur R, Hellerstein J. Eddies: Continuously adaptive query processing. In: Chen W, Naughton JF, Bernstein PA, eds. Proc. of the 2000 ACM SIGMOD Int'l Conf. on Management of Data. Dallas: ACM Press, 2000. 261~272.
  • 4Hellerstein J, Franklin M, Chandrasekaran S, Deshpande A, Hildrum K, Madden S, Raman V, Shah MA. Adaptive query processing: Technology in evolution. IEEE Data Engineering Bulletin, 2000,23(2):7-18.
  • 5Carney D, Cetinternel U, Cherniack M, Convey C, Lee S, Seidman G, Stonebraker M, Tatbul N, Zdonik S. Monitoring streams?A new class of DBMS applications. Technical Report, CS-02-01, Providence: Department of Computer Science, Brown University, 2002.
  • 6Guha S, Mishra N, Motwani R, O'Callaghan L. Clustering data streams. In: Blum A, ed. The 41st Annual Symp. on Foundations of Computer Science, FOCS 2000. Redondo Beach: IEEE Computer Society, 2000. 359-366.
  • 7Domingos P, Hulten G. Mining high-speed data streams. In: Ramakrishnan R, Stolfo S, Pregibon D, eds. Proc. of the 6th ACM SIGKDD Int'l Conf. on Knowledge Discovery and Data Mining. Boston: ACM Press, 2000. 71-80.
  • 8Domingos P, Hulten G, Spencer L. Mining time-changing data streams. In: Provost F, Srikant R, eds. Proc. of the 7th ACM SIGKDD Int'l Conf. on Knowledge Discovery and Data Mining. San Francisco: ACM Press, 2001. 97~106.
  • 9Zhou A, Cai Z, Wei L, Qian W. M-Kernel merging: Towards density estimation over data streams. In: Cha SK, Yoshikawa M, eds. The 8th Int'l Conf. on Database Systems for Advanced Applications (DASFAA 2003). Kyoto: IEEE Computer Society, 2003. 285~292.
  • 10Gibbons PB, Matias Y. Synopsis data structures for massive data sets. In: Tarjan RE, Warnow T, eds. Proc. of the 10th Annual ACM-SIAM Symp. on Discrete Algorithms. Baltimore: ACM/SIAM, 1999. 909-910.

共引文献161

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部