海量数据分析平台元数据管理的设计研究

Design and research on metadata management of massive data analysis platform

针对目前元数据管理系统中的不足,将高效、快捷、灵活作为目标,设计海量数据分析平台的元数据管理系统。系统使用XML Schema对元数据结构进行描述,并且以此结构自动在后台XML数据库系统中创建库,实现用户界面的生成。在前端使用XForam装载,实现XML数据提交。在业务逻辑层中通过数据库访问结构对数据进行存取,并且对元数据创建Lucene索引,实现元数据的有效管理。最后,对系统进行实现,表示设计的元数据管理系统能够满足实际需求,实现数据的有效管理。

Aiming at the shortage of current metadata management system,the metadata management system of massive data analysis platform is designed with the goal of high efficiency,rapidity and flexibility.The system uses XML schema to describe the metadata structure,and automatically creates the database in the background XML database system with this structure to generate the user interface.In the front end,xforam is used to load and submit XML data.In the business logic layer,the data is accessed through the database access structure,and the Lucene index is created for metadata to realize the effective management of metadata.Finally,the implementation of the system shows that the designed metadata management system can meet the actual needs and achieve effective data management.