摘要
大数据管理是随着时代和技术发展而提出和演化的命题。随着大数据从传统的结构化数据向无结构化数据的转移,Key/value存储、NoSQL、MapReduce等技术成为数据库技术之外大数据管理的多样化手段。MapReduce以其开放性成为当前大数据的代表技术,在大数据应用中,如何让MapReduce与数据库高效协同,发挥各自的技术优势和平台优势,提供高性能、高可扩展性、高可用性的大数据服务平台成为重要的研究课题。本文讨论在大数据存储、管理与服务主题上的观点和技术路线,探索将MapReduce作为数据库新的应用与开发平台的可行性。
Big data management is a proposition that came up and is evolving along with time and technology development. As big data research focus moves from traditional structured data to unstructured data, Key/ value store, NoSQL, MapReduce etc. became diverse means for big data management besides database. MapReduce is the mainstream technique for big data because of its open feature. It is a critical issue to make MapReduce cooperate with database efficiently in order to provide a big data service platform of highperformance, high scalability and high availability. This paper discusses the technical opinions on big data storing, management and service topics, and explores the feasibility of use MapReduce as new application and development platform for databases.
出处
《科研信息化技术与应用》
2013年第1期19-29,共11页
E-science Technology & Application
基金
国家科技重大专项"核心电子器件
高端通用芯片及基础软件产品"(2010ZX01042-001-002)
