流式数据查询系统

Streaming Data Query System

近年来,随着互联网和物联网的快速发展,海量的数据在很多应用中都会出现,而这其中有很大一部分数据是以流数据的形式存在的.流数据的特点是快速、大量、无序,并且要求快速的响应.研究表明,传统的关系型数据库并不适用于这种流式数据的应用场景,因此如何开发出一套新型的数据查询系统来满足流式数据的处理需求就成为当前研究的一个热点课题.本文借鉴当前几个有代表性的流式数据管理系统的优点,分析流式数据查询系统的关键问题,综合考虑流数据接口定义、数据预处理,查询语言定义、查询执行过程,系统监控、系统界面等问题,设计并实现一个可用的流式数据查询系统.最后,通过采集具体的新闻流式数据验证系统的各项功能和性能,实验结果表明,该流式数据查询系统具有良好的数据查询性能.

In recent years, with the rapid development of the Internet and the Internet of Things, the mass of data in many applications will appear, and a large part of the data is in the form of streaming data. Streaming data is characterized rapid, massive, disorderly, and also requires quick response. The research shows that the traditional relational database is not suitable for the application of the streaming data. Therefore, how to develop a new type of data query system is a hot topic in the current research. In this paper, it uses the advantages of several prevalent data management systems, analyzes the key problems of the streaming data query system and consideres the definition of data interface, data preprocessing, query language definition, query execution process, system monitoring, system interface and other issues to design and implement an available streaming data query system. Finally, it evaluates the system by the specific news streaming data. The results show that the streaming data query system has a good data query performance.