分层实时计算的大数据挖掘技术研究

Research on Big Data Mining Technology for Layered Real-time Computing

计算机和网络平台具有通用性,可针对计算机网络建立分层计算平台,将计算平台分层转换成多个信任层,由此降低计算模型实施难度,提高分层计算的扩展性和灵活性。文章研究实时计算引擎组件Presto和Storm,探索分层实时计算的大数据挖掘技术,并通过在企业财务管理、政府档案管理中的运用,给出发展多媒体技术、优化数据挖掘算法、配合其他系统使用数据挖掘技术,为大数据挖掘技术的发展指明方向。

Computer and network platform is universal.It is suggested to set up a layered computing platform for the computer network,which can be transformed into multiple layers of trust,so as to reduce the difficulty of implementing the computing model and improve the scalability and flexibility of layered computing.The real-time computing engine components Presto and Storm has been studied to explore the big data mining technology of layered real-time computing.Further direction of developing big data mining technology has been pointed out through the application of the technology in enterprise financial management and government file management,including the development of multimedia technology,the optimization of data mining algorithms,and the combination of data mining technology with other systems.