多数据流滑动窗口并发连接方法

Simultaneous Sliding Window Join Approach over Multiple Data Streams

提出一种多数据流滑动窗口连接方法M3Join及其实现架构Roujoin·Roujoin由一个连接路由表和多个连接区组成,其内容根据并发连接请求设置,先将新元组插入缓冲区,然后根据其路由标记查找连接路由表进入合适的连接区执行连接或输出给用户·如果产生连接元组,则更改其路由标记后送回连接路由表,并反复迭代直到没有连接元组·由于共享中间结果,在处理多个并发查询时只需扫描流元组一遍·实验结果表明M3Join具有良好的性能,能够满足并发连接查询处理的需求·

Recently there has been a growing interest in sliding window join for scenarios,in which streams arrive at very high rates and a data stream management system is registered with many simultaneous queries. In order to process these continuous queries, a novel window join approach named M3Join and its implementation architecture Roujoin are proposed. Roujoin contains a join-routing-table and several joinareas, and is initialized or updated according to those simultaneous queries. Each tuple in the data streams is extended with a route tag. When an original tuple arrives, it is inserted into the corresponding buffer in one of the join-areas. Then it searches the join-routing-table and switches into the right join-area to perform join operations or return to the end users. The generated join tuples, whose route tags have been updated, iterate the above search and join procedures until there is no join result produced. Other original tuples are processed in the same way. The approach needs only one scan over the data streams since different join queries share the intermediate results. The experimental results indicate that the approach is feasible and efficient.