期刊文献+

基金管理投资研究系统数据清洗及质量控制 被引量:1

Cleaning and Quality Control of Data in Investment Research System of Fund Management
下载PDF
导出
摘要 在充分分析基金管理公司估值系统、交易系统、外部资讯数据和用户需求的前提下,自主研发了一套适合基金管理公司业务需求的ETL(extract transform load)程序,将各相关业务系统和资讯系统的数据加载到数据仓库中,并开发了一套基于oracle的存储过程以实现数据的清洗和数据质量控制工作。通过在某基金管理公司投资研究系统的运用,证明该设计方式在满足业务需求并保证系统可扩展性的同时,能简化ETL程序开发的复杂度,提高系统的可维护性。其所使用的数据清洗和核对方式对银行、保险等金融机构类似应用的开发有较高的参考价值。 A system of cleaning and quality control of data in investment research system was built after investigating the estimation system,trade agent system,external information data of fund management company and analysis of the requirements of users.The system consists of an ETL program,and other products such as oracle,oracle stored procedures.Data of related business system and information system were uploaded to data warehouse.An oracle-based storing process was developed to realize data cleaning and data quality control.This design approach can meet business requirements,ensure system scalability,simplify the complexity of the development of ETL program and improve the maintainability of the system.The used approach has a high reference value for design and develop the application systems in financial institutions such as banks and insurance agents.
出处 《武汉理工大学学报(信息与管理工程版)》 CAS 2011年第5期725-727,734,共4页 Journal of Wuhan University of Technology:Information & Management Engineering
基金 国家自然科学基金资助项目(60802030) 山东省中青年科学家科研奖励基金资助项目(BS2009DX0036)
关键词 基金管理公司 估值系统 数据清洗 数据质量控制 ETL fund management company estimation system data cleaning data quality control ETL
  • 相关文献

参考文献4

二级参考文献15

  • 1王海峰,徐立臻,董逸生,胡孔法.一个数据仓库建模工具的设计与实现[J].计算机工程,2005,31(13):220-222. 被引量:5
  • 2王骏.构建数据仓库实例[J].计算机工程与设计,2006,27(19):3663-3665. 被引量:7
  • 3王磊,李一凡,赵怀慈.银联数据仓库系统中ETL的设计和实现[J].微电子学与计算机,2007,24(5):66-68. 被引量:5
  • 4Common Warehouse Metamodel (CWM) Specification Version 1.0,2 February, 2001.
  • 5Sheth A P. Changing Focus on Interoperability in Information Systems: From System, Syntax, Structure to Semantics [ A ]. Interoperating Geographic Information Systems [C]. Kluwer Academic Publlshem. 1998,5.
  • 6Galhardas H, Florescu D.An Extensible Framework for Data Cleaning[R].Institute National de Recherche en Informatique et en Automatique, Technical Report, 1999.
  • 7Hernandez MA and Stolfo JS.Real-world Data is Dirty:Data Cleansing and The Merge/Purge Problem[J].Journal of Data Mining and Knowledge Discovery,1998,(2).
  • 8Kimball R.Dealing with dirty Data[J].DBMS, 1996,9(10) :55.
  • 9Guyon I,Matic N and Vapnik V.Discovering Information Patterns and Data Cleaning.In Advances in Knowledge Discovery in Data Mining[M].MIT Press/AAAI Press,1996.
  • 10Simoudis E,Livezey B and Kerber R.Using Recon for Data Cleaning[A].Proceedings of KDD[C].1995.282-287.

共引文献16

同被引文献8

引证文献1

二级引证文献2

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部