面向API调用的开放数据存储管理研究

RESEARCH ON OPEN DATA STORAGE MANAGEMENT FOR API-CALLING

数据开放共享是大数据应用的基础和保障,API调用将是开放数据利用的主流方式。提出一种面向API调用的开放数据存储管理模型ODSMM(Open Data Storage Management Model),实现数据集描述和元数据、文件、结构化数据存储管理。基于模型,提出一种面向海量开放数据的API调用优化算法Skip-Where。通过实验验证了模型和算法的有效性。

Data ｏpening and sharing is the foundation and guarantee of big data application. API-calling will be the mainstream way of ｏpen data utilization. An ｏpen data storage management model （ODSMM） for API-calling is proposed, which realizes dataset description, metadata, file and structured data storage management. Based on the model, an API-calling optimization algorithm （Skip-Where） for massive ｏpen data is proposed. The validity of the model and algorithm is verified by experiments.