基于Spring MVC的大数据交易集市平台

Big Data Trading Market Platform Based on Spring MVC

传统的大数据交易集市以促成大数据交易为主,类似普通商品交易平台,提供的主要功能偏重于数据目录管理、交易过程的事务管理.这种方式存在诸多弊端,除公开数据外,各数据所有者考虑到数据安全、隐私或数据被滥用,或分享数据损害自身竞争优势,仍对数据交换持谨慎态度,同时各企业对不同行业、多领域存在的数据了解有限,制约了数据的交换,仅靠数据目录无法完全达到能力输出的目的,为有效解决上述弊端,本文设计了一种大数据交易集市平台,系统采用Spring MVC构建后台整体架构,集成了Redis、MyBatis等技术,向数据机构提供公用的Hive集群保存数据集,并实现了数据集购买,查看样本数据,用户筛选数据集内容等功能.

Traditional big data trading markets focus on facilitating big data transactions, similar to ordinary commodity trading platforms. Their main functions lie in data catalog management and transaction management in the transaction process. This traditional mode has many drawbacks. Except for public data, considering data security, privacy, data abuse,or damage to own competitive advantages due to data sharing, data owners are still cautious about data exchange. At the same time, companies have limited understandings of data in many fields, which also restricts data exchange. The capacity output cannot be fully achieved by the data catalog alone. To effectively address the above drawbacks, this study designs a big data trading market platform. The system uses Spring MVC to build the overall back-end architecture and integrates Redis, Mybits, and other technologies to provide data institutions with public Hive clusters for saving data sets.Moreover, it realizes the functions of data set purchase, sample data viewing, and user screening of data set content.